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Preface 


Feedback Control of Dynamic Systems is for a first course in feedback control at 
the senior level for all engineers. The book includes a review of dynamic response 
and the Laplace transform but assumes that the student is familiar with the essential 
ideas, including writing equations of motion and using the Laplace transform to 
solve linear constant ordinary differential equations. The emphasis of the book is 
on controller design, and the intention is to introduce the root locus, frequency 
response, and state feedback design methods as alternative approaches to the same 
goal: designing controllers that will process sensor measurements so as to cause a 
dynamic system to meet tracking accuracy and disturbance-rejection specifications 
in spite of model errors. 

The material in the book is used at Stanford University as the basis for two 
ten-week courses taken by seniors and first-year graduate students, especially in 
the departments of Aeronautics and Astronautics, Electrical Engineering, and Me- 
chanical Engineering. The courses complement a graduate course in linear systems 
and are prerequisites to courses in digital control, optimal control, flight control, 
and smart product design. The book can also be used to support a one-semester 
(15 week) course or a single one-quarter course. An outline of how the material 
might be used is given following an overview of the philosophy and contents of 
the book. 

In this second edition, we have retained the basic philosophy and content of 
the first edition while being responsive to the suggestions of students, colleagues, 
and reviewers. Throughout the book we have rewritten material to improve clar- 
ity and to generally help the reader understand the material better. Specifically, 
we have added material on the Laplace transform, time response, and block- 
diagram manipulation in Chapter 2. We have reorganized the presentation and 
expanded the treatment of system Type and Routh’s stability criterion in Chapter 3. 


Vii 


Vill 
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In the treatment of stability margins and sensitivity in Chapter 5, we have begun 
to tie in the single-input, single-output concepts with the more general methods 
necessary for the multivariable case. In Chapter 6 we introduce the idea of a tradeoff 
curve between control effort and tracking accuracy in the context of the linear 
quadratic regulator design. As background for dynamic-response and frequency- 
response material, we have added an appendix on complex analysis. We have also 
thoroughly reworked the problems in each chapter to be sure that the statements 
are clear and unambiguous and that in each case the questions are appropriate to 
the section to which the problem applies. 

We believe that this book is distinguished by its emphasis on controller de- 
sign, by a uniform level of treatment of the root locus, frequency response, and 
state-feedback ideas, and by the extent to which the several design methods are 
integrated into a comprehensive set of tools to serve the control designer. As a 
consequence of these features, the book is a superior foundation for further study 
of systems, feedback, and advanced control. The emphasis on design begins in 
Chapter 3 following the review of dynamic response. Before any sophisticated 
analysis method is presented, the influence of feedback on disturbance rejection, 
tracking accuracy, and model errors is introduced. Here, in the context of a first- 
order model for speed control, the concepts of proportional, integral, and derivative 
(PID) control are introduced. In this way, the student gets the idea of what control 
is all about before the tedious rules of the root locus or of the Nyquist Stability 
Criterion are developed. By this approach, the central issues of control design are 
brought forward and can be kept in the foreground during the necessary analysis 
that goes with construction of sophisticated design tools. 

The level of treatment of the root locus, frequency response, and state-feedback 
techniques is that of a senior engineering student who has had a course in circuits 
or dynamic response that uses the Laplace transform to solve linear constant differ- 
ential equations. The advanced algebra essential to using state-variable methods on 
multivariable systems is omitted, to be treated in a subsequent course. Our objec- 
tive in the first course is to teach the student to design single-input, single-output 
systems by each of the methods and to experience the unique insights given by 
each of them on the design problem. Also emphasized is the fact that it is mainly 
insight that the techniques provide; the details of numerical calculations of specific 
parameter values is expected to be done by computer. The unity of the methods is 
illustrated by the use of similar examples during the individual presentations and by 
the collection in Chapter 7 of several case studies where all three methods are used 
to contribute to the designs. We suggest that instructors should consider a look- 
ahead to these examples and perhaps select one to be considered as a continuing 
illustration of each technique as it is introduced. 

The contents of the book are organized into eight chapters and three ap- 
pendixes. The chapters include some sections of advanced or enrichment ma- 
terial marked with O that can be omitted without interfering with the flow of 
the material. The appendixes include background and reference material such as 
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matrix and complex variable analysis that support the book but are not part of it. In 
Chapter |, a brief history of control is traced from the ancient beginnings of process 
control to the contributions of flight control and electronic feedback amplifiers. Our 
intent is to help the student appreciate where this field came from and to introduce 
the names of those pioneers who contributed to getting it to the present state of 
development. Chapter 2 is a review of writing equations of motion for dynamic 
systems and solving for the dynamic response. Emphasis is on mechanical, elec- 
trical, and electromechanical devices. This material can be omitted if the students 
are well prepared or it can be used for review to smooth out the usual nonuniform 
preparation of students in the course. At a minimum, the material on the effects of 
extra zeros and poles on the transient response should be covered. Chapter 3 in- 
troduces feedback in an elementary setting to permit concentration on the essential 
ideas of using feedback to reduce tracking errors, improve disturbance rejection, 
and reduce sensitivity to model errors. PID controllers, anti-windup circuits, and 
the idea of system type are treated here. 

Following the overview of feedback, the core of the book presents the design 
methods based on root locus, frequency response, and state feedback in Chapters 4, 
5, and 6 respectively. In Chapter 7, the three approaches are integrated in several 
case studies and a framework for design is described that includes a touch of 
the real-world context of practical control design. The final Chapter 8 is a brief 
summary of the main issues in the design of digital controllers and is a transition 
to this important branch of control design. 

In a ten-week quarter, it is possible to cover the nonboxed sections of Chapters 
3, 4, 5, and 6 but the pace must be brisk. For those on the semester calendar, 
several lectures can be devoted to review of dynamic response and some of the 
boxed sections can be treated, such as the material on analysis of zero-memory 
nonlinearities, by describing functions and the root locus. It should also be possible 
to include treatment of one of the case studies and to introduce a computer-aided 
design tool. Finally, a two-quarter course can cover the first five chapters in the 
first quarter and Chapter 6 (state-space methods) and Chapter 7 (case studies) in 
the second quarter with computer-aided analysis and design throughout. This is 
how we use the book at Stanford; we do not cover Chapter 8 as we have later 
courses in digital control for which another book is used. 

A word is in order respecting computer aids. Many of the original root locus 
plots in the book were generated with programs written in BASIC at Stanford some 
time ago. In recent years we have used and made available to the students PC- 
MATLAB and the Control Toolbox from The Mathworks. We also used CTRL-C, 
a product of Systems Control Technology, Inc. for many of the calculations and 
plots in the book. The nonlinear simulations were done with SIMNON, a product of 
Prof. K. J. Ástróm's Department of Control at Lund Institute of Technology. Many 
other computer-aided control system design packages exist, including MATRIX, 
from Integrated Systems, Inc. and CC from Systems Technology, Inc. It is our 
assumption that any engineer doing control design today will have access to one 
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or more of these tools or their equivalent but it is also our firm belief that to use 
these tools effectively the engineer must understand the details of the methods 
being used so that the results from the computer can be evaluated and checked for 
reasonableness by independent analysis. The First Law of Computers for engineers 
remains "Garbage In, Garbage Out." 

Finally, we wish to acknowledge our great debt to all those who have con- 
tributed to the development of feedback control into the exciting field it is today 
and specifically to the considerable help and education we have received from our 
students and our colleagues. In particular we have benefitted in this effort by many 
discussions with others who have taught introductory control at Stanford: Profs. 
A. E. Bryson, Jr., R. H. Cannon, Jr., D. B. Debra, and S. Rock. We also ap- 
preciate the comments and help of Dr. M. Anderson, Dr. T. Trankle, T. Iwata, H. 
Aghajan, Prof. M. Rabins, Prof. S. Desa, Prof. J. Chiasson, David M. Ward, Peter 
Sherman, and H. Lipkin. Smooth production of the book was again managed by 
Tom Robbins, Karen Myer, and the Addison-Wesley staff. 


Stanford, California G.EE 
LDE 
A. E.-N. 
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1.1 


An Overview 
and Brief History 


of Feedback 


Control 


Introduction 


Control is a very common concept. The term is used to refer to certain specific 
human-machine interactions, as in driving an automobile, where it is necessary to 
control the vehicle if one is to arrive safely at a planned destination. Such sys- 
tems are called manual controls. Automatic control involves machines only, as in 
room-temperature control, where a furnace is turned on and off depending on a 
thermostat reading to control the temperature in winter, and a similarly controlled 
air conditioner is used to control the temperature in summer. An extensive body 
of knowledge common to both manual and automatic control has evolved into the 
discipline of control systems design, the subject of this book. The list of variables 
subject to control is vast, being limited virtually only by one’s imagination. In 
mechanisms such as robots, control has been applied to position, speed, and force, 
for example. In the chemical industry, control is applied to fluid flow and liquid 
level, to gas flow and gas pressure, to chemical concentrations, and to many other 
variables. Within the human body, blood pressure, blood sugar, cell carbon dioxide, 
and eye-pupil diameter are only a few of the many variables controlled by biological 
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FIGURE 1.1 
Component block 
diagram of a 
room-temperature 
control system. 


Heat loss. 


Desired 
temperature 


Room 
temperature 


Thermostat 


mechanisms that are equivalent to automatic control and can be studied by the 
methods of feedback control. The occurrences of control are very widespread, 
both in nature and as a result of engineering design, and the methods of analysis 
and design required of control engineers can be very useful indeed. 

Especially important is the special class of control systems composed of those 
that use feedback. Characteristic of this class, the variable being controlled — 
whether temperature, speed, or whatever—is measured by a sensor, and the in- 
formation is fed back to the process to influence the controlled variable. The prin- 
ciple is readily illustrated by a very common system, the household furnace con- 
trolled by a thermostat. A picture of the components is suggested by the sketch in 
Fig. 1.1. We call such a picture a component block diagram. It identifies the 
major components as blocks in the system, omits details, and, without math, 
shows the major directions of information and energy flow from one component to 
another. 

A qualitative analysis of the operation of this system is readily done. Suppose 
that when the power is applied, both the temperature in the home where the ther- 
mostat is located and the outside temperature are significantly below the desired 
temperature. The thermostat will be on, and the control logic will transmit power 
to the furnace gas valve, which will open, causing the furnace to fire, the blower 
to run, and heat to be supplied to the house. If the furnace is properly designed, 
the input heat Q;, will be much larger than the heat loss Q sur, and the room tem- 
perature will rise until it exceeds the thermostat setting by a small amount. At this 
time, the furnace will be turned off, and room temperature will start to fall toward 
the outside value. When it falls a degree or so below the set point of the thermostat, 
the thermostat comes on again, and the cycle repeats. From this example, we can 
identify the generic components of the elementary feedback control system. These 
are shown in Fig. 1.2. 

The central component in Fig. 1.2 is the process or plant,* one of whose vari- 
ables (temperature) is to be controlled. In our illustrative example, the "process" is 
the house. The output is the house temperature, and the disturbance signal is the 
flow of heat from the house due to conduction through the walls, roof, windows, and 


* As many control problems are involved in factories, or “plants,” the term is often used as a generic 
name of the object to which control is applied. 


FIGURE 1.2 
Component block 


diagram of elementary 


feedback control. 
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doors to the lower outside temperature. (The outward flow of heat also depends 
on wind, open doors, and so on.) The actuator is the device that can influence 
the controlled variable of the process; in our case, the actuator is the gas furnace. 
Actually, the furnace has a pilot light, which usually involves feedback; a gas 
valve, which also involves feedback; and a blower fan with various nonfeedback 
controls to time its on and off cycles, based on efficient operation of the system. 
These details are mentioned to illustrate that many feedback systems contain com- 
ponents that themselves form other feedback systems.* The component we labeled 
“thermostat” in Fig. 1.1 has been divided into three parts in Fig. 1.2. These are 
the reference and output sensors and the comparator (the summation symbol). For 
purposes of feedback control, one needs to measure the output variable (house tem- 
perature), to sense the reference variable (desired temperature), and to compare the 
two.’ Our purpose in this book is to present methods for the analysis of feedback 
control systems and their components and to present the most important classes of 
design techniques the engineer can use with confidence in applying feedback to 
solve problems of control. We will also study the specific advantages of feedback 
that compensate for the additional complexity it demands. 


Reference 
sensor 


A First Analysis of Feedback 


The value of feedback can readily be demonstrated by quantitative analysis of 
a simplified model of a familiar system, the cruise control of an automobile. A 
component block diagram of the system is drawn in Fig. 1.3. In order to analyze 


* Jonathan Swift (1733) said it this way: “So, Naturalists observe, a flea Hath smaller fleas that on him 
prey; And these have smaller still to bite “em; And so proceed, ad infinitum.” 


* It is sometimes not possible for the controlled variable and the sensed variable to be, the same. For 
example, while we wish to control the house temperature, the thermostat is in one particular room that 
may or may not be the same temperature as the rest of the house. If you work in the study, while the 
thermostat is in the living room near a roaring fireplace, you can freeze with the desired temperature 
set at 75°! 
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FIGURE 1.3 
Component block 
diagram of automobile 
cruise control. 


FIGURE 1.4 
Functional block diagram 
of cruise control. 
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this system, we need a set of mathematical relations among the variables of our 
system, a set that is called a model of the system. For this example, we will ignore 
the dynamic response of the car and consider only the static behavior; dynamics 
will play a major role in our later studies. Furthermore, we will assume that for 
the range of speeds to be used by the system, the relations may be approximated 
as linear. For the vehicle, we measure speed on a level road at 55 miles per hour 
(mph) and find that a unit change in our control, which is the gas pedal angle, 
causes a 10 mph change in speed. When the grade changes by 1%, we measure 
a speed change of 5 mph. The speedometer is found to be accurate to a fraction 


R=reference speed, miles per hour (mph) 
U-gas pedal angle, degrees 

Y=actual speed, miles per hour 

Wzroad grade, percent 


FIGURE 1.5 
Open-loop cruise control. 
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of 1 mph and can be considered exact. With these relations, we can draw the 
functional block diagram shown in Fig. 1.4. The idea of this block diagram is to 
represent specific mathematical relationships. The lines are like wires that carry 
signals, and the block is like an amplifier that multiplies the signal at its input by 
the number or gain marked in the block to give the output signal. To sum two or 
more signals, we show lines for the signals coming into a circle with a X. inside 
and algebraic signs beside each to show if it is added with a plus or a minus sign to 
give the output of the summer. In Fig. 1.4, no relation is given for the controller; 
we wish to compare the effects of a 1% grade when the speed is set for 55 with 
and without feedback in the controller. In the first case, the controller does not use 
the speedometer reading and sets U = R/10, as shown in Fig. 1.5. This type of 
control is called “open-loop” because there is no closed path or loop around which 
signals can go in the topology of the block diagram. In this case, the output speed 
is given by 


Yo = 10(U — 0.5W) 


10 [(R/10) — 0.5W] 
= R- 5W. 


If W = 0, a level road, and R = 55, then the speed will be 55, and there is no 
error. However, if W = 1, a 1% grade, then the speed will be 50, and we have a 
5 mph error in the speed. Let's compare this with a feedback scheme, as shown in 
Fig. 1.6. In this case, the equations are 


Y, = 10U — 5W 


U = R — 0.9Ya4 
Ya = IO0R — 9Y4 — 5W 
Ya = R — Wn. 


Thus, we see that in this case, if the input set-point R = 55, and the grade W = 1, 
then the speed will be 54.5, only a 0.5 mph error. The effect of feedback has been 
to reduce the speed error by a factor of 10! 
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FIGURE 1.6 
Closed-loop cruise 
control. 


1.3 


If we had included a gain factor in the controller greater than 1, the improve- 
ment in the error would have been even greater. Unfortunately, there are limits to 
how high this gain can be made, both because of limits in the power of the engine 
and, more importantly, because when dynamics are introduced, the feedback can 
make the response worse than before. The dilemma is illustrated by a familiar 
situation where it is easy to change a loop gain. If one tries to raise the gain of 
a public-address amplifier too much, the sound system will squeal in a most un- 
pleasant way. The gain in the feedback loop from the speakers to the microphone 
through the amplifier and back to the speakers is too much. Trying to get the gain as 
large as possible, to reduce the errors without making the system become unstable 
and squeal, is what feedback control is all about. 


A Brief History 


An interesting history of early work on feedback control has been written by Mayr 
(1970). He traces the control of mechanisms to antiquity and describes some of 
the earliest examples—the control of flow rate to regulate a water clock, and the 
control of liquid level in a wine vessel, which is thereby kept full regardless of how 
many cups are dipped from it. Actually, the control of fluid flow rate is reduced 
to the control of fluid level, since a small orifice will produce constant flow if the 
pressure is constant, which is the case if the level of the liquid above the orifice 
is constant. The mechanism of the liquid-level control invented in antiquity, and 
still used for level control, is a float valve similar to that in the water tank of the 
ordinary flush toilet. The float is arranged so that, as the water level falls, the flow 
into the tank increases; and as the level rises, the flow is reduced and, if necessary, 
cut off. A sketch of such a device is seen in Fig. 1.7. Notice that here sensor and 
actuator are combined in one device, the carefully shaped float and supply-tube 
combination. 


FIGURE 1.7 

Control of liquid level 
and flow as practiced by 
the ancients. 


FIGURE 1.8 

Sketch of Drebbel’s 
incubator for hatching 
chicken eggs. (Adapted 
from Mayr, 1970.) 
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Supply ——_» 


A more recent invention described by Mayr that uses feedback control is the 
temperature regulator of a furnace used to heat an incubator, a system designed by 
Drebbel about 1620. A sketch is shown in Fig. 1.8. The furnace consists of a box 
to contain the fire, with a flue at the top, fitted with a damper. Inside the fire box is 
the double-walled incubator box, the hollow walls filled with water to transfer the 
heat evenly to the incubator. The temperature sensor is a glass vessel filled with 
alcohol and mercury and placed in the water jacket around the incubator box. As 
the fire heats the box and the water, the alcohol expands and the riser floats up, 
lowering the damper on the flue. If the box is too cold, the alcohol contracts, the 
damper is opened, and the fire burns hotter. The desired temperature is set by the 
length of the riser, which sets the opening of the damper for a given expansion of 
the alcohol. 

A famous problem in the chronicles of automatic control was the search for a 
means to control the speed of rotation of a shaft. Much early work (Fuller, 1976) 
seems to have been motivated by the desire to control automatically the speed of 


Damper 


Flue gases 


Float 


Mercury and 
alcohol 
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FIGURE 1.9 

Photograph of a steam 
engine from the shop of 
J. Watt. (British Crown 
Copyright, Science 
Museum, London.) 


Ad eris 


the grinding stone in a wind-driven flour mill. Of various methods attempted, the 
one with the most promise turned out to be one using a conical pendulum, or 
flying-ball governor. This device was used to measure the speed of the mill; the 
sails of the driving windmill were rolled up or let out via ropes and pulleys, much 
like a window shade, to maintain fixed speed. But it was not the windmill that 
made the flying-ball governor famous; it was its adaptation to the steam engine in 
the laboratories of James Watt around 1788. A photograph of an early engine is 
shown in Fig. 1.9, a close-up of a flying-ball governor in Fig. 1.10, and a sketch 
showing the operation of the device in Fig. 1.11. 


FIGURE 1.10 

Watt steam engine (1789- 
1800) with centrifugal 
governor. (British Crown 
Copyright, Science 
Museum, London.) 
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FIGURE 1.11 
Sketch of the flying-ball governor 


LN ZZ 


valve 


Pulley from 
engine 


The action of the centrifugal governor is simple to describe. Suppose the 
engine is operating in equilibrium when a load is suddenly applied. At this point, 
engine speed will slow, and the balls of the governor will drop to a smaller cone. 
Thus, the ball angle is used to sense the output speed. This action, through the 
levers, will open the main valve to the steam chest (the actuator) and admit more 
steam to the engine, restoring most of the lost speed. To hold the steam valve at a 
new position, it is necessary for the fly balls to rotate at a different angle, implying 
that the speed under load is not exactly the same as before. To recover exactly the 
same speed in the system, it would be necessary to reset the desired speed setting 
by changing the length of the rod from the lever to the valve. Other inventors 
introduced mechanisms that integrated the speed error and thus provided automatic 
reset. An analysis of these systems is presented in Chapter 3, where it will be 
shown that integral action can cause feedback systems to have zero steady-state 
error to constant disturbances. 

Watt was a practical man, like the millwrights before him, and he did not 
engage in theoretical analysis of the governor. The early development of control 
theory has been traced by Fuller (1976) from studies of Huygens in 1673 to Maxwell 
in 1868. Fuller gives particular credit to the contributions of G. B. Airy, who was 
professor of mathematics and astronomy at Cambridge University from 1826 to 
1835 and Astronomer Royal at Greenwich Observatory from 1835 to 1881. Airy 
was concerned with speed control; if his telescopes could be rotated counter to the 
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rotation of the earth, a fixed star could be observed for extended periods. He used 
the centrifugal-pendulum governor and discovered that it was capable of unstable 
motion—“‘and the machine (if I may so express myself) became perfectly wild" 
(Airy, 1840; quoted in Fuller, 1976, 1). Fuller attributes to Airy the first discussion 
of instability in a feedback control system, the analysis of such a system using 
differential equations, and hence the beginnings of the study of the dynamics of 
feedback control. 

The first systematic study of the stability of feedback control was apparently 
given in the paper “On Governors” by J. C. Maxwell (1868). An exposition of 
Maxwell’s contribution is given in Fuller (1976). In this paper, Maxwell developed 
the differential equations of the governor, linearized them about equilibrium, and 
stated that stability depends on the roots of a certain (characteristic) equation hav- 
ing negative real parts. Maxwell attempted to derive conditions on the coefficients 
of a polynomial that held if all the roots had negative real parts. He was successful 
only for second- and third-order cases. The problem of determining criteria for 
stability was set as the problem for the Adams Prize of 1877, which was won 
by E. J. Routh.* His criterion, developed in his prize-winning essay, remains of 
sufficient interest that control engineers still learn how to apply his simple tech- 
nique. Analysis of the characteristic equation remained the foundation of control 
theory until the invention of the electronic feedback amplifier by H. S. Black in 
1927 at Bell Telephone Laboratories. As an aside, we should note here that shortly 
after the publication of Routh's work, the Russian mathematician A. M. Lyapunov 
(1892) began studying the question of stability of motion. His studies, based on the 
nonlinear differential equations of motion, also included results for linear equations 
that are equivalent to Routh's criterion. His work was fundamental to what is now 
called the state-variable approach to control theory, but it was not introduced into 
the control literature until about 1958. 

The development of the feedback amplifier is briefly described in an interesting 
article based on a talk by H. W. Bode (1960), reproduced in Bellman and Kalaba 
(1964). With the introduction of electronic amplifiers, long-distance telephoning 
became possible in the decades following World War I. However, as distances in- 
creased, so did the loss of electrical energy in spite of the use of large-diameter 
wire, and more and more amplifiers were needed to replace what was lost. Unfor- 
tunately, with so many amplifiers came much distortion, as the small nonlinearities 
of the vacuum tubes then used in electronic amplifiers were multiplied over and 
over. As a solution to this problem of distortion reduction, Black proposed the 
feedback amplifier. As we will see in Chapter 3, it turns out that the more we 
wish to reduce such distortion, the more feedback we need to apply. The loop 
gain from actuator to plant to sensor to actuator must be made very large. As we 


*E, J. Routh was first academically in his class at Cambridge University in 1854. J. C. Maxwell was 
second. In 1877, Maxwell was on the Adams Prize Committee that set the problem of stability as the 
topic for the year. 


1.3 / A Brief History 11] 


mentioned earlier in connection with the automobile cruise control, with high gain 
the feedback loop begins to sing and is unstable. Here was Maxwell’s and Routh’s 
stability problem in a different technology, where the dynamics were so complex 
(differential equations of order 50 being common) that Routh’s criterion was not 
very helpful. As communications engineers familiar with the ideas of frequency 
response and with the mathematics of complex variables, the workers at Bell Labs 
turned to complex analysis. In 1932, H. Nyquist published a paper describing 
how to determine stability from a graphical plot of the loop frequency response. 
From this theory, there developed an extensive methodology of feedback-amplifier 
design described by Bode (1945) and still used widely in the design of feedback 
controls. 

Simultaneously with the development of the feedback amplifier, feedback con- 
trol of industrial processes was becoming standard. In this field, characterized by 
processes that are not only highly complex but also nonlinear and subject to rela- 
tively long time delays between actuator and sensor, there developed the practice of 
proportional-plus-integral-plus-derivative control—the PID controller, as described 
by Callender, Hartree, and Porter (1936). This technology, based on extensive ex- 
perimental work and simple linearized approximations to the system dynamics, 
led to standard experiments suitable to application in the field and eventually to 
satisfactory “tuning” of the coefficients of the PID controller. Also under develop- 
ment at this time were devices for the guidance and control of aircraft; especially 
important was the development of sensors suitable for measuring aircraft altitude 
and speed. An interesting account of this branch of control is given in McRuer 
(1973). 

An enormous impulse was given to feedback control during World War II. In 
the United States, engineers and mathematicians at the MIT Radiation Laboratory 
combined their knowledge to bring together not only the feedback amplifier theory 
of Bode and the PID control of processes, but also the theory of stochastic processes 
developed by N. Wiener (1930). The result was the development of a comprehen- 
sive set of techniques for the design of control mechanisms, or servomechanisms, 
as they came to be called. Much of this work was collected and published in the 
records of the Radiation Laboratory by James, Nichols, and Phillips (1947). 

Another approach to control-system design was introduced in 1948 by W. R. 
Evans, who was working in the field of guidance and control of aircraft. Many of 
his problems had unstable or neutrally stable dynamics, which make the frequency 
methods difficult, and he suggested a return to the study of the characteristic 
equation that had been the basis of the work of Maxwell and Routh nearly 70 years 
earlier. However, Evans developed techniques and rules allowing one to follow 
graphically the paths of the roots of the characteristic equation as a parameter was 
changed. His method, the root locus, is suitable for design as well as for stability 
analysis and remains an important technique today. 

During the 1950s, several authors, including Bellman and Kalman in the 
United States and Pontryagin in the U.S.S.R., began again to consider the or- 
dinary differential equation (ODE) as a model for control systems. Much of this 
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1.4 


work was stimulated by the new field of control of artificial earth satellites (where 
the ODE is a natural form for writing the model) and was supported by digital 
computers, which could be used to carry out calculations that would have been 
unthinkable 10 years earlier. The work of Lyapunov was translated into the lan- 
guage of control at about this time, and the study of optimal controls, begun in 
the work of Wiener and Phillips during the war, was extended to optimization 
of trajectories of nonlinear systems based on the calculus of variations. Much of 
this work was presented at the first conference of the newly formed International 
Federation of Automatic Control, held in Moscow in 1960.* This work did not 
use the frequency response or the characteristic equation but rather worked directly 
with the ordinary differential equation in “normal” or “state” form and typically 
called for extensive use of computers. The methods so introduced are now often 
called modern control as opposed to the complex variable methods of Bode et 
al., which are termed classical. Of course, Maxwell, Routh, and Lyapunov had 
laid the foundations of the study of the differential equation in the late nineteenth 
century. Finally, beginning during the decade of the 1970s and continuing into the 
1990s, we find a growing body of work that seeks to use the best features of each 
of the available techniques (Doyle and Stein, 1981). We might call these methods 
eclectic control. 

Thus, we come to the current state of affairs, where we feel that the well- 
prepared engineer should understand many techniques, be able to choose the method 
best suited to the problem at hand, and be able to use that method to guide and 
verify automatic computer calculations. For more background on the history of 
control, a set of survey papers appears in the JEEE Control Systems Magazine, 
November 1984. 


An Overview of the Book 


The central purpose of this book is to provide an introduction to the most important 
techniques for control-system design. First, we must review (or briefly introduce) 
analysis techniques necessary to obtain models and compare design alternatives. 
In Chapter 2, we present such an introduction to model making for mechanical, 
electric, electromechanical, and a few other physical systems. Analysis of dynamic 
response is described by Laplace transforms, and the relations between time re- 
sponse and poles and zeros are discussed. Also described are the linearization of 
nonlinear models and the construction of models from experimental data. 

In Chapter 3, the basic features of feedback are described. An analysis of 
the effects of feedback on disturbance rejection, tracking accuracy, and dynamic 


*Optimal control gained a large boost when Bryson and Denham (1962) showed that the path of a 
supersonic aircraft should actually dive at one point in order to reach a given altitude in minimum time. 
This nonintuitive result was later demonstrated to skeptical fighter pilots in flight tests. 
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response is given. In the most elementary of situations, we present the essential 
problems of control and how they can be addressed. In Chapters 4, 5, and 6, we 
introduce the techniques for realizing, in more complex dynamic systems, the ob- 
jectives identified in Chapter 3. These are the methods of root locus, frequency 
response, and state-variable pole placement. The methods are not independent; 
rather, they are alternatives to the same end, with differing advantages and dis- 
advantages. The methods are fundamentally complementary, and each needs to 
be understood to achieve the most effective control-system design. Application of 
these techniques to problems of substantial complexity is discussed in Chapter 7. 
There the student will find all methods brought to bear simultaneously on a specific 
problem. Finally, in Chapter 8, we briefly introduce the problems associated with 
digital control, how sampling requires another analysis tool—the z transform—and 
how each of the design methods can, by suitable modification, be applied to design 
of computer-based control. 

Needless to say, many topics are not treated here. We do not extend the methods 
to systems with more than one input or output, so-called multivariable control. Nor 
is optimal control treated. Most lamentable is the omission of real consideration 
of nonlinear control. However, we believe that mastery of the material here will 
provide a foundation of understanding upon which the student can build knowledge 
of these more advanced topics—a foundation strong enough to allow you to build 
your own design method in the spirit of all those who toiled to give us what we 
study here. 


1.1 Several common feedback control systems are listed below. 


a) The manual steering system of an automobile 
b) The incubator of Drebbel 

c) The water level controlled by a float and valve 
d) Watt’s steam engine with flying-ball governor 
e) The automatic steering of an ocean-going ship 
f) A public address system 


You are to draw the component block diagram for these and identify the following for 
each: 


* the process 

* the actuator 

* the sensor 

* the reference input 

* the controlled output 
* the actuator output 

* the sensor output 


1.2 The thermostat in your home or office could be one of several different kinds— it 
might use a tube filled with liquid, a bimetallic strip, spring bellows, or an electronic 
controller. Describe how it works. 
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FIGURE 1.12 
Sketch of a papermaking machine. (From Åström, 1970, p. 192. Reprinted with permission.) 
t . 
id Refine Machine 
chest Screens and Headbox Presses Drying Reel 
cleaners section 
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A machine for making paper is diagrammed in Fig. 1.12. There are two main parameters 
under feedback control; the density of fibers, as controlled by the consistency of the 
“thick stock” that flows from the headbox onto the wire, and the moisture content of 
the final product that comes out of the dryers. Stock from the machine chest is diluted 
by white water returning from under the “wire” as controlled by a control valve (CV). 
A meter supplies a reading of the consistency. At the “dry end” of the machine, there 
is a moisture sensor. Draw a component block diagram and identify the seven items 
listed in Problem 1.1 for 


a) control of consistency 
b) control of moisture 


Many variables in the human body are under feedback control. For each of the fol- 
lowing controlled variables, draw the component block diagram showing the process 
being controlled, the sensor that measures the variable, the actuator that causes it to 
increase and/or decrease, the information path that completes the feedback path, and 
the disturbances that upset the variable. (You may need to consult an encyclopedia or 
textbook on human physiology for information about this problem.) 


a) Blood pressure 

b) Blood sugar concentration 
c) Heart rate 

d) Eye pointing angle 

e) Eye-pupil diameter 

f) Blood calcium level 


Draw the component block diagram for temperature control in a refrigerator. 


Draw the component block diagram for an elevator-position control. Indicate how you 
would measure the position of the elevator car. Consider a combined “coarse” and “fine” 
measurement system. What accuracies do you suggest for each sensor? 


For feedback control, it is necessary to sense the variable being controlled. Because 
of the ease with which electrical signals are transmitted, amplified, and generally pro- 
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cessed, it is often the case that we want our sensor to deliver as output a voltage 
proportional to the variable being measured. Devise the principles of operation, and 
sketch a diagram suitable to explain the operation of a sensor that would measure 


a) Temperature 

b) Pressure 

c) Liquid level 

d) Flow of liquid along a pipe (or blood along an artery) 
e) Linear position 

f) Rotational position 

g) Linear velocity 

h) Rotational speed 

i) Translational acceleration 
j Force 

k) Torque 


In each case, comment on the expected dynamic range, the linearity, and the signal/noise 
ratio of your device. 


Each of the variables listed in Problem 1.7 can be brought under feedback control. 
Describe alternative actuators that can influence each variable. Comment on the range 
of power levels available in each case. 
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2.1 


Dynamic 
Models 
and Dynamic 


Response 


introduction 


The goal of feedback control is to use the principle of feedback to cause the output 
variable of a dynamic process to follow a desired reference variable accurately in 
spite of the path the reference variable may take, the external disturbances, and 
any changes in the dynamics of the process. Before design of feedback can begin, 
however, the control engineer must construct a mathematical model of the system 
to be controlled and must understand the dynamic responses expected from the 
system to be able to see how a trial design might match the desired performance. 
Thus, two of the foundation skills of feedback-control engineering are the ability 
to model dynamic systems and the ability to obtain a quick approximate analysis 
of dynamic responses. 

In many cases, the modeling of complex systems is difficult, expensive, and 
time consuming, especially when the important steps of experimental verification 
are included. In this introductory text, we review the most basic principles of 
modeling for the most common physical systems and refer the engineer to more 
comprehensive sources such as Cannon (1967) and to specialized texts such as 
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Elgerd (1982), Etkin (1959), and Buckley (1964) for further details. For our pur- 
poses, we will introduce model making by writing equations of motion for simple 
mechanical, electrical, and electromechanical systems. We will also present re- 
sults from a few other fields of interest in control, including fluid flow and heat 
exchange. As a final topic in modeling, we will discuss some of the techniques 
used to build a model based on experimental data. Experimental techniques are 
especially useful when the process is so complex that basic equations of motion 
are too complicated or simply not available. Experimental methods are also useful 
in checking the validity of models obtained by direct means. 

Once a model is obtained in the form of dynamic equations, usually ordinary 
differential equations, the next step is to solve the equations to learn the nature 
of the response of the system. In general, solving dynamic equations is very diffi- 
cult because most realistic models are time-varying, nonlinear, and of high order. 
However, in many control problems we are often concerned with keeping the sys- 
tem at an equilibrium point and can thus restrict our study to the response of the 
system to small signals, all near this equilibrium. For this purpose, we can ap- 
proximate the nonlinear behavior by a linear model for small signals around the 
selected equilibrium. Furthermore, the time variations are often very slow when 
compared with the speed of the signals of interest, and we can consider the system 
parameters to be constant for the initial analysis. For these reasons, we devote our 
attention in this first course to the study of the response of systems that are linear 
and time-invariant. In addition to small-signal linear models, we show how it is 
sometimes possible to obtain a linear model for design purposes by using part of 
the control effort to counteract the nonlinear terms in the model. This approach 
is widely used in the field of rigid-link robotics, where the technique is called 
"computed torque." 

We study dynamic response within three domains. These three are the s plane, 
the frequency response, and the state-space domains. The basic mathematical tool 
of the s plane is the Laplace transform. A summary of this theory is given in Sec- 
tion 2.7, and a useful table of Laplace transforms and properties are on the inside 
back cover to this book. The main role of the s plane and the Laplace transform 
is to transform the linear constant ordinary differential equations of our process 
model to algebraic equations, in the complex variable s. From the solution to these 
algebraic equations, we can find the transform of the signals of interest and with the 
transform we can compute poles and zeros that are assoc‘ated with the time-domain 
solution to the differential equations. By study of special cases, we develop insight 
and intuition as to how these poles and zeros correspond to the time responses of 
interest, and, thus, guide the design in the algebraic domain of the s plane rather 
than always requiring the complicated time-domain solutions. The basic s plane 
design technique is the root locus. The frequency domain is a closely related idea 
but associated with sinusoidal signals only. The amplification and phase shift that 
a system imparts to an input signal that is sinusoidal are easily measured in the 
laboratory and are often more easily visualized as a physical concept when com- 
pared to the more abstract complex s plane representation. The state-space domain 
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follows from a standard construction of the ordinary differential equations as a 
simultaneous set of first-order equations. This form permits introduction of matrix 
notation and, for linear models, the extensive algebra of linear matrix equations can 
be used to help understand the dynamic response.* The state domain is particularly 
well suited to computer-aided analysis and design and for study of systems with 
more than one input or more than one output. We feel that these three domains— 
s plane, frequency response, and state-space—are three different directions from 
which to view, to understand, and to design control systems. The well-prepared 
control engineer needs to be familiar with each of them. 


Dynamics of Mechanical Systems 
The cornerstone for obtaining a mathematical model, or the equations of motion, 
for any mechanical system is Newton’s law, 
F = ma, (2.1) 
where 
F 


vector sum of all forces applied to each body in a system, Newtons (N) 
or pounds (Ib), 


a = vector acceleration of each body with respect to an “inertial” reference 
frame (i.e., one that is not accelerating or rotating), m/s? or ft/s?, 


m = mass of the body, kg or slug." 


Application of this law typically involves defining convenient coordinates to ac- 
count for the body’s motion—position, velocity, and acceleration—determining the 
forces on the body using a free-body diagram, and then writing the equations of 
motion from Eq. (2.1). The procedure is simplest when the coordinates chosen 
express the position with respect to an inertial frame because, in this case, the 
accelerations needed for Newton’s law are simply the second derivatives of the 
position coordinates. 

An example should help clarify ideas. Suppose we have a cart, as shown in 
Figure 2.1. For simplicity, we assume that the rotational inertia of the wheels is 
negligible and that there is friction retarding the motion of the cart, friction that is 
proportional to the cart’s speed. The cart can then be approximated for modeling 
purposes using the free-body diagram seen in Fig. 2.2, which defines coordinates, 
shows all forces on the body (heavy lines), and indicates the acceleration (dashed 


* A summary of background results in matrix linear algebra is given in Appendix C. 


* In English units, we commonly refer to the “weight” of an object in units of pounds. To obtain the 
mass in slugs, divide the weight by g (i.e., 32.2 ft/s ?). Therefore, an object weighing 1 Ib has a 
mass of 1/32.2 slugs. A slug has dimensions Ib : s?/ft. Unfortunately, in English units, we use pounds 
both for force and for mass so there is frequent confusion. In MKS units, one Newton will impart an 
acceleration of 1 m/s? to 1 kilogram. 
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FIGURE 2.1 
Example system. 


FIGURE 2.2 
Free-body diagram 
and position coordinate. 


lines). The coordinate of the cart’s position, x, is the distance from the reference 
line shown and chosen to be positive to the right. Note that the inertial acceleration 
is simply the second derivative of x (a = X) in this case because the cart position 
is measured with respect to an inertial reference. The equation of motion is found 
using Eq. (2.1). The friction force acts opposite the direction of motion and, 
therefore, is drawn opposite the direction of positive motion and entered as a 
negative force in Eq. (2.1). The result is 


u— bx = mx, (2.2) 
Or 
á . u 
A&c—X.- —, 
m m 


Another example is shown in Fig. 2.3. It consists of two masses connected 
by a spring and a damper. The force from the spring acts on both masses in 
proportion to their relative displacement, while the damper yields a force on each 
mass proportional to its relative velocity. Figure 2.4 shows the free-body diagram 
of each mass. Note that the forces from the spring on the two masses are equal in 
magnitude but occur in the opposite direction, and likewise for the damper. Note 
that a positive displacement of mass m» will result in a force from the spring in 
the directions shown. However, as indicated by the minus sign in the spring force 
term, a positive displacement of mass m, will result in a force from the spring 
opposite the direction shown. Applying Eq. (2.1) to each mass and noting that the 
forces on the right mass are in the negative direction yields 


u toO — ZX) +KO — XZ) = Mm 
—k(y = x) — DY — x) — m5), (2.3) 


Friction 
force bx 


FIGURE 2.3 
Resonant system 
example. 


FIGURE 2.4 
Forces on each mass 
for resonant system. 
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Avs A+» 
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No friction 


or, with some rearranging, 
IM E k u 
X + —(x — y)+ —(x — y) = — 
m, m, m, 
a e k 
Jc o—0 — 2) + —O — 2) = 0. (2.4) 
m» m» 


Application of Newton's law to one-dimensional rotational systems requires 
that Eq. (2.1) be modified to 


M = Ia, (2.5) 
where 


M = sum of all moments about the center of mass of a body, N : m or 
lb - ft, 

I — body's moment of inertia about its center of mass, kg : m? or 
slug - ft, 

a = angular acceleration of the body, rad/s?. 


In the special case where a point in the body is fixed with respect to an inertial 
reference, as is the case with a pendulum, Eq. (2.5) can be applied with M being 
the sum of all moments about the fixed point and J being the moment of inertia 
about the fixed point. 

An example of the application of these equations is found in the model of 
attitude motion of a satellite, such as that shown in Fig. 2.5. Satellites usually 
require attitude control so that antennas, sensors, and solar panels are properly 
oriented. For example, antennas are usually pointed toward a particular location on 
earth while solar panels need to be oriented toward the sun for maximum power 
generation. 
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FIGURE 2.5 
Communications 
satellite. (Courtesy 
Ford Aerospace 

& Communications 
Corp.) 


To gain insight into the full three-axis attitude-control system, we often con- 
sider one axis at a time. Figure 2.6 depicts this case, where motion is only allowed 
about the axis perpendicular to the page. The angle 0 that describes the satellite 
orientation must be measured with respect to an “inertial” reference, that is, a 
reference that has no angular acceleration. The control force comes from reaction 
jets that produce a moment (F.d) about the mass center. There may also be small 
disturbance moments on the satellite (Wp), primarily arising from solar pressure 
acting on any asymmetry in the solar panels. Applying Eq. (2.5) yields the equation 
of motion, 


F.d 4 Mp = IÔ. (2.6) 


If this system is controlled by measuring 0 from the antenna signal and that 
signal is used to drive the control jets, there is the possibility of some flexibility in 
the structure between the measured 0 and the applied control force. Schematically, 
the dynamic model for this common situation is as shown in Fig. 2.7. It is the 
rotational version of the resonant system shown in Fig. 2.3 and results in equations 
of motion identical in form to Eq. (2.4). The moments on each body are shown 
in the free-body diagrams in Fig. 2.8.* When summed according to Eq. (2.5), the 
result is 


1,6; + b(0; — 02) + k(0; — 02) = M, + Mp 
16> + b(0; — 01) + k(05 — 01) = O. (2.7) 


A two-dimensional mechanical system that consists of both translational and 
rotational portions is the hanging crane shown in Fig. 2.9. The free-body diagrams 


* Note that the moment from the spring is drawn in the same direction on each inertia but the moments 
are labeled to have opposite signs. This is equivalent to the situation in Fig. 2.4, where the forces were 
drawn in opposite directions and labeled to have equal signs. 
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FIGURE 2.6 
Satellite control 
schematic. 
P. 
iet Gas jet 
Inertial 
reference 
are shown in Fig. 2.10. In the case of the pendulum, the forces are shown with 
bold lines while the components of the inertial acceleration of its center of mass 
are shown with dashed lines. The inertial acceleration needs to be determined be- 
cause the a in Eq. (2.1) is with respect to an inertial reference. The total inertial 
FIGURE 2.7 
Rotational resonant 
system. 


Rotational spring with constant k and 
rotational damper with constant b 
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FIGURE 2.8 

Free-body diagrams of 
the rotational resonant 
system. 


FIGURE 2.9 


Crane with hanging load. 


M, *Mp k (84 — 89) 
b(65—64) 


bli —65) 


acceleration of the pendulum's mass center is the vector sum of the three dashed 
arrows shown. The derivation of the components of an object's acceleration, called 
kinematics, is usually studied as a prelude to the application of Newton's Laws. 
Alternatively, one could express the center of mass of the pendulum as a vector 
from an inertial reference and then differentiate that vector twice to obtain an 
inertial acceleration. 

Using the results of a kinematic study, we find that the component of acceleration 
along the pendulum is /6? and is called the “centripetal” acceleration. It is present for 
any object whose velocity is changing direction. The X component of acceleration is 
a consequence of the pendulum pivot point accelerating at the trolley's acceleration 
and will always have the same direction and magnitude as the trolley. The /6 
component is a result of angular acceleration of the pendulum and is always 
perpendicular to the pendulum. The total inertial acceleration will automatically be 
the vector sum of the three acceleration components shown in Fig. 2.10(b). 

In order to understand the / 6 and 160? terms better, consider the situation in 
Fig. 2.10(c), where the i and j axes are inertially fixed. A vector r describing the 
position of the pendulum center of mass can be expressed as 


= [(sin 0i — cos 6j. 


FIGURE 2.10 

Hanging crane: 

(a) trolley free-body 
diagram; (b) pendulum 
free-body diagram; 

(c) pendulum position 
vector. 
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u b X, friction 
N 
Reaction P 
force from 
pendulum 
(a) ^ 


(c) 


The first derivative of r is 
po l6(cos 0i + sin 8j. 
Likewise, the second derivative of r is 
ř = lÓ(cos 0i + sin 0j) = 16°(sin 0i — cos 0j. 


Note that the /0? term is aligned along the pendulum pointing toward the axis of 
rotation and that the /@ term is aligned perpendicular to the pendulum pointing in 
the direction of a positive rotation. 

Having all the forces and accelerations for the two bodies, we proceed to apply 
Eq. (2.1). In the case of the trolley, Fig. 2.10(a), we see that it is constrained by 
the tracks to move only in the x direction; therefore, application of Eq. (2.1) in 
this direction yields 


mX-bX-u-—N. (2.8) 


Conceptually Eq. (2.1) can be applied to the pendulum of Fig. 2.10(b) in 
the vertical and horizontal directions, and Eq. (2.5) can be applied for rotational 
motion to yield three equations in the three unknowns: N, P, and 0. These three 
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equations can then be manipulated to eliminate the reaction forces N and P so 
that a single equation results describing the motion of the pendulum, i.e., a single 
equation in 0. For example, application of Eq. (2.1) in the x direction yields 


N = m,X + mylÓ cos0 — m p16? sin 0. (2.9) 


However, considerable algebra will be eliminated if Eq. (2.1) is applied per- 
pendicular to the pendulum to yield 


P sin + N cosó — mpg sind = m,lÓ + myx cos0. (2.10) 


Application of Eq. (2.5) for the rotational pendulum motion where the moments 
are summed about the center of mass yields 


—Plsin0 — Nicosé = I0, (2.11) 


where J is the moment of inertia about the pendulum's mass center. The reaction 
forces, N and P, can now be eliminated relatively easily by combining Eqs. (2.10) 
and (2.11). This yields the equation 


(I + ml’) + mpgl sind = —m,lx cos6. (2.12) 


It is identical to a simple pendulum equation of motion, except that it contains a 
forcing function that is proportional to the trolley's acceleration. 

An equation describing the trolley motion was found in Eq. (2.8), but it con- 
tains the unknown reaction force, N. N can be eliminated by combining Eqs. (2.9) 
and (2.8). This yields 


(m, + m5) + bx + m,lücos0 — m,l8? sin = u. (2.13) 


Equations (2.12) and (2.13) constitute the differential equations that describe 
the motion of the crane with its hanging load. For an accurate calculation of 
the motion of the system, these nonlinear equations need to be solved. However, 
nonlinear equations are much more difficult to solve than linear ones and the 
kinds of possible motions resulting from a nonlinear model are much more difficult 
to categorize than those resulting from a linear model. It is therefore useful to 
linearize models in order to gain access to linear analysis methods. It may be that 
the linear models and linear analysis are used only for the design of the control 
system (whose function may be to maintain the system in the linear region). Once 
a control system is synthesized and shown to have desirable performance based on 
linear analysis, it is then prudent to carry out an accurate analysis of the system 
with all the nonlinearities in order to validate that performance. 

To linearize the equations of motion of the hanging crane, we could assume 
the pendulum has small motions about the vertical where cos? = 1, sinô = 6, 
and 0? z 0; thus, the equations may be approximated by 


(I + mpl’) + mpgló = —mylx 
(m, + mp) + bx + mpyló = u. (2.14) 


FIGURE 2.11 
Inverted pendulum. 
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As a second case, we could assume the pendulum has small motion about a 
vertical upward direction, as is the case for the inverted pendulum shown in Fig. 
2.11, in which case 0. = m + 6’. In this case, cos = —1 and sinô = —0' in 
Eqs. (2.12) and (2.13), and they become* 


(I + myl^)8' — m,gl0' = m,lx 
(m, + my)X + bx — mylÓ' = u. (2.15) 


To summarize, the physics necessary to write the equations of motion of a 
rigid body is given entirely by Newton's law of motion. The method for systems 
such as the inverted pendulum (Fig. 2.11) is as follows: 


1. Assign variables such as x and 0 necessary and sufficient to describe an arbitrary 
position of the object. 


2. Draw a free-body diagram of each component and indicate all forces acting on 
each body and the accelerations of the center of mass with respect to an inertial 
reference. 


3. Apply Newton's law in translation (Eq. 2.1) and rotation (Eq. 2.5) form. 


4. Combine the equations to eliminate internal forces. 


The combination of the equations to eliminate internal forces is sometimes ex- 
pedited by an intelligent choice of directions for the application of Eq. (2.1), as 
illustrated by the preceding example. It often is useful to try alternate directions 
and to evaluate the algebra required to eliminate the internal reaction forces. Ap- 
plication of Newton's laws in different directions sometimes yields what appear to 
be quite different sets of equations; however, after manipulations, the equations 
can always be shown to be equivalent. 


* The inverted pendulum is often described with the angle of the pendulum being positive for clockwise 
motion. In this case, the sign on all terms in Eq. (2.15) in 6’ or 8’ need to be reversed. 
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State Variable Form 

In Chapter 6 we will consider control system design using matrix notation. For 
that approach, we will need to arrange the differential equations that describe the 
plant into a set of simultaneous first-order equations known as state variable form. 
For example, Eq. (2.2) is 


X = —(b/m)x + u/m. 


If we define the position and the velocity as the state variables xı and x», so that 
X; = x and x2 = x , then the single second-order equation can be written in an 
equivalent way as two first-order equations 


X] — Wo 
—(b/m)x2 + (l/m)u. 


X2 
For more complex systems of rigid bodies, selecting the positions and velocities 
of the separate bodies as the state variables is usually adequate, but for any but 
the simplest systems, a more advanced study of dynamics is necessary (see Kane, 
1985). 

All the preceding examples contained one or more rigid bodies, although some 
were connected to others by springs. Actual structures — for example, satellite solar 
panels, airplane wings, or robot arms— usually bend; Figure 2.12(a) shows a very 
simple flexible beam. The equation describing its motion is a fourth-order partial 
differential equation: 


where 


E — Young's modulus 

I — beam cross-sectional moment of inertia 
p — beam density 

w = beam deflection. 


The exact solution to this equation is too cumbersome for use in the design of 
control systems, but it is often important to account for the gross effects of bending 
in control-system design. 

The continuous beam in Fig. 2.12(b) has an infinite number of vibration mode 
shapes, all with different frequencies. Typically, the lowest-frequency modes have 
the largest amplitude and are the most important to approximate well. The simpli- 
fied model in Fig. 2.12(c) can be made to duplicate the essential behavior of the 
first bending mode shape and frequency and would usually be adequate for con- 
troller design. If frequencies higher than the first bending mode are anticipated in 
the control-system operation, it may be necessary to model the beam as shown in 
Fig. 2.12(d), which could be made to approximate the first two bending modes and 


FIGURE 2.12 

(a) Flexible robot arm 
used for research at 
Stanford University; 

(b) model for continuous 
flexible beam; 

(c) simplified model for 
first bending mode; 

(d) model for first and 
second bending modes. 
(Photo courtesy of 

E. Schmitz.) 
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(b) (c) (d) 


frequencies. Likewise, higher-order models could be used if such accuracy and 
complexity were deemed necessary (Thomson, 1981, and Schmitz, 1985). 


Models of Electric Circuits 


Electric circuits consist of interconnections of sources of electric voltage and current 
with passive elements such as resistors, capacitors, and inductors, and with active 
electronic elements such as transistors and especially operational amplifiers. Elec- 
tric circuits are frequently used components of feedback-control systems because of 
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the enormous flexibility they give the designer to modify and to process electric 
signals. Operational amplifiers are in themselves examples of complex feedback 
systems, and some of the most important methods of feedback system design were 
developed by the designers of high-gain feedback amplifiers, mainly at the Bell 
Telephone Laboratories between 1925 and 1940. Electric and electronic components 
also play a central role in electromechanical energy conversion devices such as 
electric motors and generators and electrical sensors. In this brief survey, we cannot 
derive the physics of electricity or give a comprehensive review of all the important 
analysis techniques. We will define the variables, describe the relations imposed 
on them by typical elements and circuits, and describe a few of the most effective 
methods available for solving the resulting equations. 

Symbols for some linear circuit elements and their current-voltage relations 
are given in Fig. 2.13. Passive circuits consist of interconnections of resistors, 
capacitors, and inductors. 

With electronics, we increase the set of electrical elements by adding active 
devices, including diodes, transistors, and amplifiers. In signal processing and in 
circuits for control systems, the most common amplification device is the opera- 
tional amplifier, or op amp.* The symbol of the op amp is shown in Fig. 2.14. In 
typical amplifiers, the zero frequency or DC gain Ao varies from 10? to 107. We 
can take Ag to be infinity with satisfactory accuracy for most control uses. 

The basic equations of electric circuits are called Kirchhoff's laws, which are 


Kirchhoff’s current law (KCL): The algebraic sum of all currents leaving a junction 
or node in a circuit is zero. 

Kirchhoff's voltage law (KVL): The algebraic sum of all voltages taken around a 
closed path in a circuit is zero. 


With complex circuits of many elements, it is essential that the writing of 
the equations be well organized and carefully done. Of the numerous methods 
for doing this, we select for description and illustration the popular and powerful 
scheme known as node analysis. We consider the circuit shown in Fig. 2.15 for 
illustration. The first idea of node analysis is to select one node as a reference and 
to select the voltages of all other nodes as unknowns. The choice of reference is 
arbitrary as far as the method is concerned, but in active electronic circuits the 
common, or ground, terminal for signals is the obvious and standard choice. In 
the example circuit, we select node @ as the reference and the voltages va, vo, 
and vg as the unknowns. The second idea of node analysis is to write equations 
for the selected unknowns using the current law (KCL) at each node. We express 
these currents in terms of the selected unknowns by using the element equations. 


*Heaviside introduced the mathematical operation p to signify differentiation so that pv was to be 
taken as dv/dt. The Laplace transform incorporates this idea, using the complex variable s. Ragazzini, 
Randall, and Russell (1947) demonstrated that an ideal, high-gain electronic amplifier permitted one to 
realize arbitrary “operations” in s, and they named such an amplifier the “operational amplifier." 


FIGURE 2.13 
Elements of electric 
circuits. 


FIGURE 2.14 
The operational amplifier. 
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FIGURE 2.15 
An example circuit, 
the bridged tee. 


If the circuit contains voltage sources, we must substitute a voltage law (KVL) for 
such sources. For the circuit at hand (Fig. 2.15), we start with a trivial KVL to 


the effect that 
Vp = Vi. 


At node @ we have the equation 


Va —VàQ . V9 — vo dvo 
— + ———_ + C, — = 0, 
Ri R> ! dt 
and at node @ the KCL is 
vo — vo d(ve — vo) 
— + C$,—————— = 0. 
R> à dt 


(2.16a) 


(2.165) 


(2.16c) 


These three differential equations describe the circuit. Later, we will discuss how 
to solve these and any other set of linear, ordinary differential equations by using 


the Laplace transform. 


As a supplementary exercise, we can again write the equations as a set of 
simultaneous first-order differential equations by selecting the capacitor voltages 
vc, and vc, as unknowns. Here vc, = vg, vc, = vo — ve, and still vg = vj. 
Thus, vg = vi, vo = vc,, and v@ = vj — vc,. In terms of vc, and vc,, Eq. 


(2.165) is 


ye, =~ (vg — ve.) 
Ri R> dt 


dvc, P 
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Rearranging this equation into standard form, 
dvc, tft. 2 we tfi» i 
—— = -—|— + >ja -lla t =l t lv (2.17 
dt ar ak c.a] 2m XL ( a 
In terms of vc, and vc,, Eq. (2.16c) is 


Yi. ~ Co. re, d 
——À 7 + C5—(vi — vc, — vi) = 0. 
R5 Miu" un "c; vi) 


Again, in normal form, the equation is 


avo, _ _ Vey l Vi 


= — Ve. T , 
dt C5R5 CR, ^ C2R2 


(2.17b) 


Equations (2.16a, b, and c) are entirely equivalent to Eqs. (2.17a and b) in de- 
scribing the circuit. Equation (2.17) gives the equations in state-variable form. 

As another simple example of node analysis, we consider the standard op amp 
circuit shown in Fig. 2.16(a). Node analysis will give us an equation from KCL at 
node (D. This equation is 


Vp —Vi , Và — Vo d 
—— + —— + C— — yo) = 0. 
Ri R2 Cae vo) 


The law of the amplifier as given in Fig. 2.14 is in this case 
Vo = —Áovo. 
If we let Ay — œ, then vm = 0, and the equation reduces to 


Ya- Cayo 


-1L - - 0. 


Ri R5 dt 


Finally, if we let Ry — œ (an open circuit), then we have the circuit of Fig. 2.16(b) 
and the equation 


C dv, Vi 
dt R] i 
Or 
l t 
Vo = -zzl vi(r) dT + v,(0). (2.18) 


Thus, the ideal op amp in this circuit performs the operation of integration. 

The equations of much more complicated circuits can be established by nodal 
analysis. However, when the equations are linear, it is more common to use the 
Laplace transform directly on the element equations, reducing them to algebraic 
form, and to solve the resulting linear algebraic equations. 


34 Chapter 2 / Dynamic Models and Dynamic Response 


FIGURE 2.16 


(a) A simple op-amp 
circuit; (b) The electronic 


integrator. 


2.4 


Ro 


(a) 


(b) 


Models of Electromechanical Systems 


Electric current and magnetic fields interact in many ways, three of which are 
important to an understanding of the operation of most electromechanical energy 
conversion devices, such as linear and rotary motors and electric sensors of motion. 
In this section, we will state these relations and sketch a few typical configurations 
used in control devices. For greater detail respecting electromagnetic principles as 
discovered by researchers such as Ampere, Faraday, Weber, Tesla, and many others, 
a book on physics, such as Halliday and Resnick (1970), should be consulted. For 
a general introduction to the application of these principles to electromechanical 
energy conversion devices, see Smith (1980); for a thorough treatment of DC 
motors, see Electrocraft (1980). 

The first important relation we note between current and magnetism is that an 


FIGURE 2.17 
Toroid wrapped with N 
turns. 
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electric current establishes a magnetic field. The strength of the field at a particular 
point depends on the intensity of the current, the materials, and the geometry of 
the situation. A typical idealized case is sketched in Fig. 2.17, where a toroid of 
radius R made of material with permeability is wrapped with N turns of wire 
carrying i amperes. The field strength at the center of the toroid is given by 


fe ar 

B = mRNT (2.19) 
The important fact is that the field strength is proportional to the current strength and 
to the number of turns of wire around the toroid. The permeability u is a property 
of the material and represents the extent to which the material aids the current in 
establishing the field. For air, po = 4v X 10 7 Wb/A : m. For a ferromagnetic 
material such as iron under typical nonsaturated conditions, the permeability can be 
several thousand times mo. The net effect of this relationship between current and 
magnetic field is that a strong field can be established by sending current through 
many turns of wire wrapped around a ferromagnetic material. If a small gap is cut in 
the toroid core of the scheme in Fig. 2.17, the field will be slightly reduced but will 
be accessible in the gap to interact with current-carrying conductors, which can be 
placed there. Such a device is an electromagnet, so called because the magnetic field 
is formed and controlled by the electric current in the wire. Some materials, known 
since prehistoric times, can establish a magnetic field because of the electrical 
properties of their constituent molecules. These are called permanent magnets, 
since the field does not come and go with an external current. In many cases, such 
as in small motors and generators used in many control applications, a permanent 

magnet may be entirely satisfactory for establishing the required magnetic field. 
The second electromagnetic effect of interest to us is the fact that a charge 
q moving with vector velocity v in a magnetic field of intensity B experiences a 
force F given by the vector cross-product F = qv X B. If the moving charge is 
composed of a current of i amperes in a conductor of length / meters arranged at 
right angles to the field strength of B tesla, then the force at right angles to the 
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FIGURE 2.18 
Geometry of a 
loudspeaker; a form 
of motor for linear 
motion. 


*— — Cone 
Bobbin 
wi 
Low force 

CENE MR X" suspension 
magnet 

plane of i and B has the magnitude 

F — Bli newton. (2.20) 


This equation is the basis of using a magnetic field to convert electric energy from 
the source of current i into mechanical energy by arranging for the force F to do 
work on some mechanical object. Such devices are called motors, and Eq. (2.20) is 
the law of motors. For example, a loudspeaker for reproducing sound from electric 
signals contains such a motor. A typical geometry is sketched in Fig. 2.18. The 
permanent magnet establishes a radial field in the cylindrical gap between the poles 
of the magnet. When a current is caused to flow in the wire wound on the bobbin, 
the force causes the bobbin to move left or right and the cone to move against the 
air. As the cone moves back and forth, the fluctuations of air pressure propagate 
and are heard as sound. 

If we approximate the effects of the air as if the cone had equivalent mass M 
and viscous damping coefficient d, we can write the equations of motion of the 
device. Suppose the magnet establishes a uniform field of 0.5 T, and the bobbin 
has 20 turns at 2-cm diameter. The current is at right angles to the field, and the 
force of interest is at right angles to the plane of i and B, so Eq. (2.20) applies. 
In this case, the parameter values are B = 0.5 T and 


2T 
l 20 100^ 1.26m 


FIGURE 2.19 
A loudspeaker showing 
the electric circuit. 
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Thus, 
F = 0.63i newton. 
The mechanical equation, as developed in Section 2.2, is 
MX + dx = 0.63i. (2,21) 


Equation (2.20) also can be used in finding the force on the rotor of a motor and 
in many other useful applications. 

In addition to Eq. (2.20), which expresses force (a mechanical variable) in 
terms of current (an electrical variable), there is also a relation giving the effect 
of mechanical motion on electricity. The basic fact is that if a charge is moving in 
a magnetic field and is forced along a conductor, an electric voltage is established 
between the ends of the conductor. The relation is that if a conductor (which is 
filled with charged particles) of length / meters is moved at a velocity v meters 
per second through a constant field of B teslas at right angles to the direction of 
the field, then the voltage between the ends of the conductor is given by 


e(t) — Blv volts. (2.22) 


This expression is called the /aw of the generator, for it is the basis for generating 
electric power by moving a conductor in a field and letting e cause current to flow 
in an external circuit. 

Considering again the situation of the loudspeaker (Fig. 2.18), we see that if 
motion results according to Eq. (2.21), the voltage across the coil is given by Eq. 
(2.22), where the velocity is x. The result is 


€coil = 0.63x. (2.23) 


In the circuit of Fig. 2.19, these two effects are both important. Assume the 
amplifier output resistance is R and the speaker equivalent inductance is L. The 
equations of motion are, for the mechanical parts, 


Mx +dx = 0.631, (2.24a) 
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FIGURE 2.20 
Sketch of a DC motor. 


and for the electrical parts, 


get + Ri = v, — 0.63x. (2.24b) 
dt 

For control of rotary motion, a common device is the direct-current (DC) 
motor. A sketch of the basic components is given in Fig. 2.20. In addition to 
housing and bearings, the nonturning part (stator) has magnets, which establish a 
field across the turning part (rotor). The magnets may be electromagnets or, for 
small motors, permanent magnets. The rotor is wound with wire through which 
current is forced via the brushes. The (rotating) commutator causes the current 
always to be sent through the armature, a collection of conductor windings, so that 
it will produce the maximum torque in the desired direction. If the direction of the 
current is reversed, the direction of the torque is reversed. 

The underlying principles are given by the motor law (B/i) and the generator 
law (Blv). However, rather than give the field strength and winding geometry, it 
is standard to express the torque developed in the rotor in terms of the armature 
current and a torque constant K, as 


T = Kyla, (2.25) 


and to express the voltage generated as a result of rotation* in terms of the shaft 
rotational velocity 0 and an electric or emf constant Ke as 


e = Kð. (2.26) 


In consistent units, it is true that K, equals K,, but in some cases a torque constant 
will be given in other units, such as ounce-inches per ampere, and the electric con- 
stant may be expressed in units of volts per 1000 rpm. In such cases, the engineer 
must make the necessary translations to be certain the equations are correct. 
Using these relations, a set of equations for the DC motor with armature driven 


*Because the generated electromotive force (emf) works against the applied armature voltage, we call 
it the back emf. 
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FIGURE 2.21 

Electrical circuit and 
mechanical diagram of 
a DC motor: (a) electric 
circuit of armature; 

(b) free-body diagram 
of rotor. 
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by an amplifier can be written by considering the network with back emf included 
for the electrical side and a free-body diagram of the rotor with motor torque in- 
cluded for the mechanical side. A typical electric circuit is shown in Fig. 2.21(a) 
and the corresponding free-body diagram in Fig. 2.21(b). In the mechanical dia- 
gram, we have assumed significant compliance in the motor shaft, which connects 
the motor rotor, with inertia J,, at angle 0,,, to the load, with inertia J; at angle 
0,;. We assume the twisting of the shaft can be modeled adequately as a spring 
of displacement torque constant k and viscous torque constant b. The electrical 
equation is 
dig 


Lady T Ratia = Va K.0, (2.27) 


and the mechanical equations are (see Eq. 2.7) 
Fate T b(0,, T ĝi) t k(0, — 01) = Kiia 
JiÖı + bÔ, — Om) + k(O; — Om) = 0. (2.28) 


These are the equations we will need to use when studying feedback control of DC 
motors. 
Another device used for electromechanical energy conversion is the AC induc- 


(a) 
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FIGURE 2.22 
Torque-speed curves for 
two typical induction 
motors: (a) low-rotor- 
resistance machine; 

(b) high-rotor-resistance 
machine, with four values 


of armature voltage given. 


tion motor invented by N. Tesla and based on the following concept. Suppose we 
construct a rotor of conductors with no commutator and no brushes. Suppose the 
stator magnetic field can be made to rotate at high speed (perhaps 1800 rpm). The 
moving field will induce currents (the principle of induction) in the rotor, which 
will, in turn, be subject to forces according to the motor law. These forces will 
cause the rotor to turn so that it chases the rotating magnetic field. 

Elementary analysis of the AC motor is more complex than is that of the DC 
motor so, rather than give the details in terms of the motor geometry, we present 
the experimental facts in the form of a set of curves of speed versus torque for 
fixed frequency and varying amplitude of applied voltage. A typical set appears in 
Fig. 2.22(a) for a low-rotor-resistance machine used for power applications and in 
Fig. 2.22(b) for a high-resistance machine typical of servomotor applications. 

For analysis of a control problem involving an AC motor, such as that described 
by Fig. 2.22(b), we make a linear approximation to the curves for speed near zero 
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and voltage at midrange to obtain the expression 
T = Kiva — K20. (2.29) 


For the electrical side, experiments are performed to measure the armature resis- 
tance and inductance for inclusion in the analysis. Given Kj, K2, Ra, and La, the 
analysis proceeds as in the case of the DC motor. 

In addition to the DC and AC motors mentioned here, control systems use 
brushless DC motors (Electrocraft, 1980), stepping motors (Kuo, 1982), and vari- 
able reluctance motors (Kuo, 1982). The development of models for these machines 
is given in the works cited, and the models do not differ in principle from the motors 
considered above. In general, the analysis, supported by experiment, develops a 
function of the torque in terms of voltage and speed similar to the AC-motor torque- 
speed curves given in Fig. 2.22. From these curves, a linearized formula such as 
Eq. (2.29) is obtained for use on the mechanical side, and an equivalent circuit con- 
sisting of a resistance and a reactance is obtained for use on the electrical side. 


Elementary Aspects of Other Dynamic Systems 
2.5.1 Heat Flow 


Some control systems involve regulation of temperature for portions of the system. 
The dynamic models of temperature-control systems involve the flow and storage 
of heat energy. Heat energy flows through substances at a rate proportional to the 
temperature difference across the substance; that is, 


1 
g = R — 15) (2.30) 


where 


= heat energy flow, J/s, 
R = thermal resistance, ° C/J/s, 
T = temperature, ° C. 


Q 
| 


The net heat-energy flow into a substance affects the temperature of the substance 
according to 


T= —q, (2.31) 


where 
C = thermal capacity, J/°C. 


Typically, there would be several paths for heat to flow into or out of a substance, 
and the g in Eq. (2.31) would be the sum of heat flows obeying Eq. (2.30). For 
example, a box with all but two sides insulated (1/R = 0) is shown in Fig. 2.23. 
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FIGURE 2.23 
Thermal dynamics 
example. 
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Application of Eqs. (2.30) and (2.31) yields 


huc la mq 
TOR RU 1), 
where 
C, = thermal capacitance of substance within box, 
To = temperature outside, 
T, — temperature inside, 
R = thermal resistance of box top, 


R, = thermal resistance of box side. 
Normally, the material properties are given in tables as 
1. The specific heat at constant volume c,, which is then converted by 
C = mc,, 
where m is the mass of the substance; 
2. The thermal conductivity* k, which is converted to R by 
I _ kA 
R DC 
where A is the cross-sectional area and / is the length of the heat-flow path. 


For a more complete discussion of dynamic models for temperature-control 
systems, see Cannon (1967) or textbooks on heat transfer. 
2.5.2 Incompressible Fluid Flow 


Fluid flows are common in many control-system components, one of the most com- 
mon being the hydraulic actuators used to move the control surfaces on airplanes. 


*In the case of insulation for houses, resistance is quoted as "R" values, where R-11, for example, 
refers to a substance that has resistance to heat flow equal to 11 in. of solid wood. 
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FIGURE 2.24 
Water tank example. 


The physical relations governing fluid flow are continuity, force equilibrium, 
and resistance. The continuity relation is simply a statement of the conservation of 


matter: 
m = Win — Wout, (2.32) 
where 
m = fluid mass within a prescribed portion of the system, 
Win = mass flow rate into the prescribed portion of the system, 
Wout = mass flow rate out of the prescribed portion of the system. 


Application of this relation to the water tank shown in Fig. 2.24 yields 


"E 
h= Ap in — Wout), (2.53) 


A — area of tank, 

p — density of water, 

m/Arho = height of water, 
m = mass of water in tank. 


> 
Il 


Force equilibrium must apply exactly as described by Eq. (2.1) for mechanical 
systems. However, for fluid-flow systems, some forces may be the result of a fluid 
pressure acting on a piston. In this case, the force from the fluid would be 


f = pA, (2.34) 
where 


f = force, 
p = pressure in fluid, 
A = area on which fluid acts. 
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FIGURE 2.25 
Force balance example. 


Figure 2.24 shows the application of Eqs. (2.1) and (2.5) to a piston-type 
actuator. The result is 


Ap = Fp = Mx, 
where 
A = area of piston, 
p — pressure in chamber, 
M = mass of piston, 
X — position of piston. 


In many cases of fluid-flow problems, there is some restriction of the flow 
due to a constriction in the path or to friction. The general form of the effect of 
resistance is given by 


l 


doc ci a p)”, (2.35) 


where 


w mass flow rate, 
P1, p2 = pressures at ends of path through which flow is occurring, 
R,a@ = constants whose values depend on the type of restriction. 


The constant œ takes on values between 1 and 2, the most common being 
approximately 2 for high flow rates—having a Reynolds number (Re) > 10°— 
through pipes or through short constrictions or nozzles. For very slow flows through 
long pipes or porous plugs where the flow remains laminar (Re < 1100), a = 1. 
Flow rates in between these extremes can yield intermediate values of a. 

Applying this relation to the water tank example in Fig. 2.25 would relate 
the outflow to the water level. The relatively short restriction at the outlet would 
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typically yield a = 2; therefore 


l 
Wout = —(pı — pa)'”, (2.36) 


R 
where p, = pgh, the hydrostatic pressure, and p, is the ambient pressure outside 
the restriction. 

Note that a = 2 indicates that the flow is proportional to the square root of 
the pressure difference and therefore produces a nonlinear equation of motion. For 
the initial stages of control-system analysis and design purposes, it is typically 
very useful to linearize these equations so that the design techniques described 
in this book can be applied. Linearization involves the selection of an “operating 
point’—for example, Ao and po in the water tank example— and expanding the 
nonlinear term according to 


(17 e) = 1 + Be, (2.37) 


where & «€ 1. Equation (2.36) can thus be written as 


Vor = apo Pr, TED 
out R Do — Pa 


- ees Ap | 


R 2 po 7 Pa 


where the p; in Eq. (2.36) has been expressed as po + Ap. The linearizing approx- 
imation made in Eq. (2.38) is valid as long as Ap < po — pa, that is, as long 
as the system pressure excursions from the chosen operating point are relatively 
small. 

Combining Eqs. (2.33) and (2.38) yields the linearized equations of motion 
for the water tank level: 


bones VP0~ Pa 141 Ap 
ji R 2 po — Pa 


But since p = pgh, the equation reduces to 


Ah = 


l 
Ap 


Ah = + 


Win VP07 Pa 


Ap pAR 


ee, NEU 
2AR v Po ^ Pa 


where po = pgh. 

Hydraulic actuators obey the same relations as the water tank. For example, 
consider the system shown in Fig. 2.26. When the pilot valve is at x = 0, both 
passages are closed and no motion results. When x > 0 as shown, the piston will 
be forced to the left; when x < O, the high-pressure oil will enter the left side of 
the chamber and push the piston to the right. 

We assume the flow through the orifice formed by the pilot valve is proportional 
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FIGURE 2.26 
Hydraulic actuator. 
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to x; that is, 
ei = —(p, — pi)!2x 
RC 
Similarly, 


l 
w2 = RP? — pe)? x. 
The continuity relation yields 
pAy = 09, = @2, 


where p is the fluid density, and A is the piston area. 
The force balance on the piston yields 


A(pi — p2) - F = mj, 


(2.39) 


(2.40) 


(2.41) 


(2.42) 


where m is the mass of the piston and the attached rod, and F is the force applied 
by the piston rod to the control surface attachment point. Furthermore, the control 


surface moment balance yields 


16 = Fl — F,d, 


(2.43) 


where / is the moment of inertia of the control surface and attachment about the 


hinge, and F, is the applied aerodynamic load. 


o 2.6 
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To solve this set of five equations, we can combine Eqs. (2.42) and (2.43) by 
noting that the kinematic relation between 0 and y is y = 10. Furthermore, if the 
pilot valve exposes the two passages equally and R; = R2, Eqs. (2.41), (2.39), 
and (2.40) imply that 


Ps — pi = pz — Pe. (2.44) 


Because of the nonlinearity in Eqs. (2.39) and (2.40), a reference operating point 
needs to be selected, and small perturbations about that point can then be described 
by linear equations amenable to analysis. One possibility is for y = constant and 
no applied load; that is, F = 0. In this case, Eqs. (2.42) and (2.44) indicate that 


S t De 
pi = p2 = E (2.45) 


and therefore 


VPs — Pe (2.46) 


————— X. 
/2ApRI 
If y = constant but F £ 0, then Eqs. (2.42) and (2.44) indicate that 


Ds + pe t+ F/A 
jacet rm 


and 
‘ s — Pe ~ FIA 
0 = AIe a Fm. (2.47) 
J/2ApRI 


As long as the commanded values of x produce 0 motion that has a sufficiently 
small value of 0, the approximation given by Eqs. (2.46) and (2.47) are valid 
and no other linearized dynamic relations are necessary. However, as soon as the 
commanded values of x produce 0s where the inertial forces (mY and the reaction 
to JÖ) are a significant fraction of p, — pe, the approximations are no longer valid, 
and one must incorporate these forces into the equations, thus obtaining a dynamic 
relation between x and 0 that is more involved than the pure integration implied 
by Eqs. (2.46) and (2.47). 


Linearization, Amplitude Scaling, and Time Scaling 


The differential equations of motion for almost all processes selected for control are 
nonlinear. On the other hand, as we will soon see, both analysis and control design 
are far easier for linear than for non-linear models. Fortunately, as Lyapunov proved 
over 100 years ago, if the small-signal linear model valid near an equilibrium is 


A8 Chapter 2 / Dynamic Models and Dynamic Response 


FIGURE 2.27 
Magnetic ball levitator. 


stable, there is a region (which may be small, of course) containing the equilibrium 
within which the nonlinear system is stable.* With Lyapunov’s result, we can 
safely make a linear model and design a linear control for it, and at least in the 
neighborhood of the equilibrium, our design will be stable. Since a very important 
role of feedback control is to maintain the process variables near equilibrium, such 
small-signal linear models are a frequent starting point for control models. An 
alternative approach to obtain a linear model for use as the basis of control system 
design is to use part of the control effort to cancel the nonlinear terms and to design 
the remainder of the control based on linear theory. This approach is popular in 
the field of robotics and there is called the “method of computed torque.” This 
method is also a topic of research for control of aircraft. We will illustrate these 
two techniques by simple examples and by general formulas. 


2.6.1 Small-Signal Linearization 


Figure 2.27 shows a device for the magnetic levitation of a ball. The physical 
arrangement of the levitator is depicted in Fig. 2.28. The equation of motion for 
the ball from Newton’s equations (2.1) is 


mš = f(x,i) ^ mg, (2.48) 


where the force f(x, i) is caused by the field of the electromagnet and described 
by the experimental curves of Fig. 2.29 for a ball with 1-cm diameter and a mass 
of 8.4 x 107° kg. At current i; = 600 mA and displacement xı, the magnet 
force f will just cancel the gravity force mg of 82 x 10 ? N (the mass of the ball 


* In 1949, the Russian scientist Aizerman conjectured that if a certain class of systems is stable with any 
linear gain between two limits, the nonlinear system with a nonlinear gain characteristic kept between 
the same limits would also be stable. This conjecture is not true, and that's a shame! 
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FIGURE 2.28 | 
Model for ball levitation. — ' —* 
OE 
is 8.4 x 107° kg and the acceleration of gravity is 9.8 m/s?); therefore this point 
represents an equilibrium, and a linearized model can be constructed about the 
point xı, i2. The force is written in terms of the deviations from the equilibrium 
values as the expansion 
f(x; + 6x, i2 + 0i) = f(xi, 12) + K,0x t KjÓi t. (2.49) 
The linear gains are found as follows: K , is the slope of the force versus x along the 
curve fori = i2. This is found to be about 0.14 N/cm, or 14 N/m; K; is the change 
of force with current for fixed x = xı. Here it is found that for i = i, = 700 
mA at x = x1, the force is about 122 x 107? N; and at i = i4 = 500 mA at 
x = xı, the force is about 42 x 10^? N. Thus 
.,,122x10? — 42 x 107?  80x10?N 
: 700 — 500 |. 200mA 
= 400 x 10? N/A 
= 0.4 N/A. 
FIGURE 2.29 
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Substituting these values into Eq. (2.49) leads to the linear approximation for the 
force in the neighborhood of equilibrium as 


f &82x 107? + 148x + 0.48i. 


And, with this expression in Eq. (2.48), the linearized model is (using the numerical 
value for the mass and for the gravity force) 


(8.4 x 1077)x = 82 x 10? + 148x + 0.48i — 82 x 107. 
Now, since x = x, + Óx and X = 6x, the equation in terms of ôx is 


(8.4 x 107 5)8x 
ox 


148x + 0.467 
16676x + 47.661 (2.50) 


ll 


For such a simple system, the magnitudes of the parameters are not too bad, but 
even so it is good practice to try to bring constants into the range between 0.01 
and 100 or even to the range between 0.1 and 10, if possible, by careful selection 
of scale factors. The scale factors of variables may be viewed as the selection of 
appropriate units in which to measure the variables. The process is called amplitude 
scaling. In this case, the displacement is measured in meters in Eq. (2.50), whereas 
centimeters or even millimeters are more reasonable in view of the size of a typical 
motion. An equivalent process is associated with selection of appropriate units for 
time, called time scaling. As a general guideline, amplitude scale factors should 
be selected so that the expected maximum deviation of the (scaled) variables is 
+1.0, and time scaled so the expected transient time is about | unit. 

To consider the particular case for the moment, normalized variables are de- 
fined as follows: 

y= er u = 2 T = Wot. (2.51) 
X0 lo 

The effect of the time scaling is to change the differentiation so that, with time 
scaling, 


d ôx » d òx "uds d ôx 
dt d (Tl) dr ` 


Using this and substituting Eq. (2.51) into Eq. (2.50) results in 


2 2 
al hl a IL (1667xo)y + (47.6)(ig)u. 
dr? 

Dividing by «xo gives 


d?y _ 1667y , 47.6% 
di) aw Qi Xo 


u. 2,523 
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The coefficient of y can be set equal to | by taking e$ = 1667 or wọ = 40.83.* 
With this constant, the unit of time is ~ 1/40 s. For the scale factors in 6x and i, 
it appears reasonable that position be measured in centimeters, so xo = 10 ?, and 
current in amperes, so io = 1. With these values, the scaled, linearized model of 
the ball balancer is 


2 
oY = y 286. (2.53) 


Clearly, we could have selected the current scale factor ig so as to make the 
coefficient of u have a magnitude of 1.0 as well. 

Models with simple even numbers for coefficients will frequently be used in 
later examples, where it is understood that these could have been obtained by 
similar amplitude and time scaling from real physical situations. 


2.6.2 Linearization by Feedback 


To illustrate linearization by feedback, we consider the equation of a simple pen- 
dulum, which is readily obtained from Eq 2.12 with X set to 0 and an applied 
torque 7 added. The equation is 


(I + m,1*)6 + m,glsin(0) = 7 (2.54) 

If we compute the torque to be 
T = mpyglsin(0) + u (2.53) 

then the motion is described by 
(I + myl^)ó = u, (2.56) 


and this is a linear equation no matter how large the angle 0 becomes. For robots 
with two or three rigid links, this computed torque approach leads to effective 
control. 


2.6.3 General Formulas for Linearization and Scaling 


The steps described above can be expressed in greatly reduced form if one is willing 
to use matrix notation. The basic facts about matrices are collected in Appendix 
C. For small-signal linearization we begin with the original model in matrix form as 


X = f(x, u), (2.37) 


* [n view of the probable error in the plots of Fig. 2.29, a reasonable choice would be to let wo = 40 
and approximate 1667 with 1600 to make the constant easy to remember. 
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2.1 


where x = [x1x2:::x,]/ is the state vector, and f = [fif2:- fn]" is the vector of 
functions that make up the equations. We assume that the equilibrium solution is for 
the values xo, uo, so that X; = 0 = f(xo, uo). The matrix of first derivatives F is 
defined as the matrix with element in row i and column j as [6 f;/ôx j]xo, up, Where 
xo and Uo are the equilibrium values. The matrix G has elements [8 f;/8u j] xy, uo- 
With these partial derivatives, Eq. (2.54) can be written for deviations about Xo, 
Up as 


Xo + ôx + F(xo, uo) + F(r)óx + G(t)du + higher-order terms. 
Thus, the small-signal linearized equations are 
ôx = Fóx + Góu. (2.58) 


Time scaling with 7 = wot replaces Eq. (2.58) with 
l l 
ôx = —Fôx + —Gôu. 
Wo Wo 
Amplitude scaling of the state corresponds to replacing 5x with z = D; !óx, 


where D, is a diagonal matrix of scale factors. Input scaling corresponds to re- 
placing Su with v = D; 'du. With these substitutions, 


D,z = os + ep. 
Wo Wo 
l l 
z= —D;!FD,z- —D;'GD,v. (2.59) 
w0 WO 


Equation (2.59) compactly expresses the time- and amplitude-scaling operations. 
Regrettably it does not relieve the engineer of the responsibility of actually thinking 
of good scale factors so that scaled equations are in good shape. 


A Review of Dynamic Response 


We have seen that models of dynamic components can frequently be found in the 
form of an ordinary differential equation or a set of ordinary differential equations. 
Furthermore, near an equilibrium the equations are well approximated as linear and 
time-invariant. Once such model equations are found, attention is turned to their 
solution and, in control engineering, even more to the analysis of their solutions 
so that one can estimate major features of the dynamic response and can also visu- 
alize how the system might be changed to modify the response in some desirable 
direction. A computer program suitable for solving ordinary differential equations 
is sufficient to obtain a specific solution. To gain insight into why the solution has 
certain features—such as transient rise time, overshoot of final value, or transient 


EXAMPLE 2.1 


2.7 / A Review of Dynamic Response 53 


duration (settling time)—requires a more complete and comprehensive analysis 
technique. 

There are two equivalent approaches to presenting model information so that 
the required analysis can be done; one of these is via pole-zero patterns and the 
other is by steady-state frequency response. We therefore begin with a review of 
the Laplace transform and frequency response analysis. Tables of properties and 
corresponding time-transform pairs are presented. Using knowledge of the effects 
of poles and zeros, simple formulas are developed relating time-domain features 
to the transforms of signals. 


2.7.1 Introduction to the Laplace Transform 


There are two basic facts about linear constant systems that form the basis for 
almost all analysis techniques for these systems. These are 


A linear system response obeys the principle of superposition. 


The response of a linear constant system is the convolution of the input with 
the system unit impulse response. 


We will show that from the second of these properties, it follows immediately that 
the response of a linear constant system to an exponential input is also exponential, 
and from this flows the usefulness of Fourier and Laplace transforms in the study 
of linear constant systems. 

The principle of superposition states that if the system has an input which can 
be expressed as a sum of signals, the response of the system can be expressed as 
the same sum of the individual responses to the respective signals. We can express 
this principle mathematically as follows. Consider the system to have input u and 
output y, and suppose further that, with the system at rest (zero initial conditions), 
we apply the input u(t) and observe the output y;(t). We restore the system to rest 
and reset time and apply a second input u2(t) and again observe the output, which 
we call y2(t). Finally, we form the composite input u(t) = a@,u)(t) + a2u2(t). 
If superposition applies, which is true if and only if the system is linear, then the 
response will be y(t) = a ,y\(t) + azy2(f). 


Consider the system modeled by the first-order linear differential equation 
ytky =u. 


Let u = au, + &œ2u2, and assume that y = ay; + @2y2, then y = ay; +a2yp. 
If we substitute these expressions into the system equation, we obtain 


Q1y) t a2y2 + k(ayy; + a2y2) = æu, + a2U. 
From this, it follows that 


ai(y1 + ky — uy) + a2(y2 + ky2 — u2) = 0. (2.60) 
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If y; is the solution with input ui, and y2 is the solution with input u2, then 
Eq. (2.60) is satisfied, and our assumption is correct: The response is the sum of 
the individual responses and superposition holds. E 


Using the principle of superposition, we can solve for the system responses 
to a set of elementary signals and are then able to solve for the response to a 
general signal simply by decomposing the given signal into a sum of the elementary 
components and, by superposition, the response to the general signal is the sum 
of the responses to the elementary signals. In order for this process to work, the 
elementary signals need to be such that responses to them are easy to find and 
they need to be sufficiently “rich” that any reasonable signal can be expressed as a 
sum of them. The most common candidates for elementary signals for use in linear 
systems are the impulse and the exponential. 

The idea for the impulse comes from dynamics. Suppose we wish to study 
the motion of a baseball hit by a bat. The details of the collision between the bat 
and ball can be very complex as the ball deforms and the bat bends; however, 
for purposes of computing the path of the ball, the effect of the collision can be 
summarized by the net velocity change given to the ball in a very short time. 
It is as if the ball is subjected to a very intense force for a very short time: an 
impulse. The physicist Dirac suggested that such forces could be represented by a 
mathematical impulse, 6(t), which has the property that if f(t) is continuous at 
f = T, then 


+o 
| f(nDe(t — r)dt = f(t). (2.61) 
In other words, the 6 is so short and so intense that no value of f matters, except 
at the point where the 6 occurs. If we replace f by u, then Eq. (2.61) represents an 
input u(t) as the integration of impulses of intensity u(t — 7). To find the response 
to an arbitrary input by the principle of superposition, we need to find the response 
to a unit impulse. For a general linear system, we can express the impulse response 
as h(t, T), which is the response at time ¢ to an input applied at time 7. The total 
response is then the integral of these with intensity u, which is 


y(t) = | u(r)h(t, T)d 7. 
This is the superposition integral. Some linear systems are constant and some are 
time-varying. Consider a cart to be pulled along a road. If the cart is loaded with 
melting ice, the mass will vary with time and the system will not be constant. 
A. system described by a linear differential equation with constant coefficients is 
constant. If a system is constant, the response depends on what input is applied but 
does not depend on the time at which the input is applied. If the system is linear 
and constant, the impulse response is given by A(t — 7), since the response at ¢ to an 
input applied at 7 depends only on the time difference between when the impulse is 
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applied and the time we are observing the response. Constant systems are called 
“shift invariant” for this reason. For constant systems, the superposition integral 
then takes the special form 


y(t) = | u(T)h(t — r)dt 


= | u(t — T)h(r)dv. (2.62) 


— 00 


Equation (2.62) is called the convolution integral. 


We can illustrate convolution with a simple system. Consider the impulse response 
for the system described by the differential equation 


y-ky-2uc-ét(). 


Because 6(t) only has effect near t = 0, we can integrate this equation from just 
before zero to just after zero with the result 


0* 0* 0* 
| ydt + «| ydt — | ódt. 
j- 


The integral of y is just y, the integral of y over so small a range is zero, and 
the integral of the impulse over the same range is unity. The result of the integra- 
tion is 

y(0*)- y0) = 1. 


Since the system was at rest before application of the impulse, y(0 ) = 0, and we 
are left with the effect of the impulse that y(0*) = 1. For positive time, we have 
the differential equation 


y+ky =0 20073 = 1, 
If we assume a solution y = Ae?', then y = Ase“, and the equation is 


Ase*' + kAe?! = 0 
stk =0 
s= =k. 
Also, to match y(0*) = 1, it is necessary that A = 1. Thus, the solution for the 


impulse response is y(t) = h(t) = e" for t > 0. To take care of the fact that 
h(t) = 0 for negative time, we define the unit step function 


l(t) 


0 t 
1 f= 0, 
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With this definition, the impulse response of the first-order system is 
A(t) = e" Mr). 


The response to a general input is given by the convolution of this impulse response 
and the input, as follows: 


y(t) = | h(r)u(t — T)d T 


— 06 


= | e "l(r)u(t — r)dt 
= | e "u(t — r)dr. m 
0 


An immediate consequence of convolution is that an exponential time function 
input of the form e“ results in an output that is also an exponential time function 
H(s)e*' changed only in amplitude by the function H(s). The amplitude of the 
output exponential when the input is a unit exponential is called the transfer function 
of the system. Notice especially that the constant s may be complex as s = o+ jo, 
and thus that both the input and the output may be complex. If we let u(t) = e*' 
in Eq. (2.62), 


y(t) = | u(r)h(t — T)dT 


| h(r)u(t — T)dT 


= h(r)e' "dre? 


= H(s)e"'. 


We can compute the transfer function for the system of Example 2.2 with input 
u = e*'. We take the same system equation 


y(t) + ky(t) = u(t) = e”. 


We assume that we can express y(t) as H(s)e?'. With this form, we have y = 
sH(s)e?', and the equation reduces to 


sH(s)e*' + kH(s)e"' = e". 


EXAMPLE 2.4 
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We can solve for the transfer function H(s) as 


i arr 


Substituting back, the output is therefore y = e?'/s + k. gi 


The most common use of the exponential response of linear constant systems 
is in finding the response to a sinusoid—the frequency response. The calculation 
goes this way. In order to use superposition, it is necessary first to express the 
sinusoid as a sum of two exponentials. The relation (due to Euler) is 


A. ; 
Acos(wt) = ge Te Jj") 


If we let s = jw in the basic response formula, we find that the response to 
u(t) = e/®' is y(t) = H(jo)e/^' and, in the same way, the response to u(t) = 
e j|? is H(—jw)e /*'. The response to the sum of these two exponentials, which 
make up the cosine signal, is the sum of the responses, namely 


y(t) = 2 [Haye + H(-jo)e ?"']. 


The transfer function H(j«) is a complex number that can be represented in polar 
form or magnitude and phase form as H(jw) = M(w)e/® or just H = Me/^. 
With this substitution, the expression for y(t) becomes 


y(t) - Ay el 1*9 Ht e J@ttd) 
2 


AM cos(wt + ). 


For the first-order system we have been using, the transfer function for s = jw is 
e l 
jo +k’ 


from which M = 1/ /w? + k? and $ = tan™!(—w/k). The response of this system 
to a sinusoid u = A cos(wt) will be 


y(t) = AM cos(wt + œ). P3 


The conclusion to be drawn from this exercise is that the response of a linear 
constant system to a sinusoid of frequency w is a sinusoid of the same frequency 
with amplitude multiplied by the magnitude of the transfer function evaluated at 
the input frequency and with a phase given by the phase of the transfer function at 
the input frequency. 

The frequency response approach is generalized by the introduction of the 
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EXAMPLE 2.5 


Laplace Transform of a signal f(t) as 


F(s) = | f (De "dr. (2.63) 
If we apply this transform to the convolution, Eq. (2.62), the result is easily 
computed to be 


Y(s) = H(s)U(s). (2.64) 


With the formula from Eq. (2.64), we have a means to compute the response of 
linear, constant systems to quite general inputs. Given any input and any system, 
we compute the transform of the input and the transfer function for the system. 
The transform of the output is then given by Eq. (2.64) as the product of these 
two transforms. To get the output time function, we need only compute the inverse 
transform of Y(s). A number of aids are available to help with each of these 
steps. For example, in order to help with the computation of the transform of 
input signals and the computation of the inverse transform to get y(t) from Y (s), 
there are extensive tables of transforms of elementary functions and also tables of 
properties that permit us to find complex transforms from simpler ones. Table A.1 
in the appendix has a set of useful properties, and Table A.2 has transforms of a 
few common signals from which, using Table A.1, more complex signal transforms 
can be developed. Each of the entries in these tables follows from direct application 
of the definition of the transform. The process of inversion requires the opposite 
process, whereby a complex transform is reduced to a sum of simpler terms that 
can be found in the table. The basic tool of this table-based approach to Laplace 
transform inversion is the partial fraction expansion, which is best illustrated by 
example. 


Suppose we have computed Y (s) and found 


(s + 2)(s + 4) 


T SEF DS +3) 


The elementary entry in the table of transforms is in the form 1/(s + a), and we 
want to expand Y (5) into a sum of such terms. The idea is to find constants C; so 
that 
1 1 l 
Y(s).= Ci- + Co—— + C5——. 
(s) ls ed 5 +3 

In order to evaluate the constants, we equate the two forms of Y(s) and solve. The 
easy way to get the solution is to solve the equations for particular values of s. 
For example, if we multiply both equations by s and set s = 0, we find 


_ (s +2)(s + 4) _ 8 


Lo (s DG r3): S 


2.7 / A Review of Dynamic Response 59 


In a similar fashion, we evaluate 


Be (s + 25 4) E. 
t7 dibBAR (00 73 
and 
^ _ +2844), i awl 
LEN EO | LUE 


The correctness of the result is readily checked by adding the components again to 
verify that the original function is recovered. With the partial fractions, the solution 
can be looked up in the tables at once to be 


um 8 | 3 =f E -—3f 
y(t) = 310 ne l(t) ae l(t). g 


The problem of partial fraction expansion is slightly more complex if the function 
has repeated roots— in that case, it is necessary to differentiate the equations after 
multiplying by the appropriate factor. 


The Final Value Theorem 

A very useful property of the Laplace transform known as the final value theorem 
follows easily from the development of partial fraction expansion. Suppose we have 
a rational transform Y (s) of a causal signal y(t) and we wish to know the final 
value y(t) from Y (s). There are three possibilities for the limit. It can be constant, 
undefined, or unbounded. If Y (s) has any pole in the right-half plane or a multiple 
pole on the imaginary axis, then y(t) will grow and the limit is unbounded. If all 
poles of Y(s) are in the left-half plane except for a simple pair on the imaginary 
axis, then y(t) will contain a sinusoid that persists forever and the final value is 
not defined. Only one case provides for a constant final value: if all poles of sY(s) 
are in the left-half plane, then all terms of y(t) will decay to zero except for the 
term corresponding to the pole at s = 0, and that term is a constant. Thus, in this 
case the final value is given by the residue of the pole at the origin. We can state 
this result as a theorem: 


If all poles of sY (s) are in the left-half plane, then 


lim y(t) = lim sY (s). 
te $— 


In addition to having tables of transforms and tables of properties of transforms 
for handling the computation of U(s) and the inversion of Y (s), it is valuable to 
have techniques that help in finding the transfer function of the system. This is 
especially important when the system is a composite of several simpler systems 
connected together with internal feedback. For this purpose, there is the theory of 
block diagrams. This topic is sufficiently important to our task in control design 
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FIGURE 2.30 
Three examples of elementary block diagrams. 


(a) 


that a careful development of the rules and techniques of block diagram reduction 
is given in a separate section, which follows. 


2.7.2 The Block Diagram 


To obtain the transfer function, we need to find the Laplace transform of the system 
equations and solve the resulting algebraic equations for the relation between the 
input and the output. In many control systems, the system equations can be written 
so that they are composed of several components that do not interact except that 
the input of one part is the output of another part. In these cases, it is easy to 
draw a graph known as a block diagram that represents the relationships, and the 
equations can be solved by a graphical simplification, which is often easier and 
more informative than algebraic manipulation, even though the methods are in 
every way equivalent. Drawings of three elementary block diagrams are seen in 
Fig. 2.30. It is convenient to think of each block as representing an electronic 
amplifier with the transfer function printed inside. The interconnections of blocks 
include summing points where any number of signals may be added together. 
These are represented by a circle with the math symbol of summation, X, inside. 
In Fig. 2.30(a), the block with transfer function G;(s) is in series with the block 
with transfer function G2(s), and the overall transfer function is given by the 
product G5 G,. In Fig. 2.30(b), the two component systems are in parallel with 
their outputs added, and the overall transfer function is given by the sum of G, 
and G2. These results are very easy consequences of the equations that describe 
the block diagrams. In Fig. 2.30(c), we have a more complicated case, in that the 
two blocks are connected in a feedback arrangement so that each feeds into the 
other. Here it is worthwhile to look at the equations, solve them, and then relate 
them back to the picture. We have 


UL =R+) 
Y) = G2G4Uj 
Yi S Gi Uj. 


FIGURE 2.31 


2.7 / A Review of Dynamic Response 61 


The solution of these equations is 
Y,(s) ——É—-R. (2.65) 


We can express the solution by the rule: 


The gain of a single-loop feedback system is given by the forward gain divided 
by 1 minus the loop gain. 


The three elementary cases given in Fig. 2.30 can be used in combination to 
solve for any transfer function defined by a block diagram by repeated reduction. 
However, the manipulations can become tedious and are subject to error when the 
topology of the diagram gets complicated. Figure 2.31 shows examples of block 
diagram algebra that complement those shown in Fig. 2.30. 


Examples of block diagram algebra: (a) moving a pick-off point; (b) moving a summing point; (c) conversion to unity 


feedback. 


uy 
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In all cases, the basic principle is to simplify the topology while maintaining 
exactly the same relations among the remaining variables of the block diagram. In 
relation to the algebra of the underlying linear equations, block diagram reduction 
is a graphical way to solve equations by eliminating variables. 


EXAMPLE 2.6 Consider the system shown in Fig. 2.32, and suppose we wish to find the transfer 
function for the corresponding system. 

First, we may simplify the block diagram by replacing the feedback loop in- 

volving G; and G3 by its equivalent transfer function (see Fig. 2.30(c)). The next 

step is to move the pick-off point preceding G2 to its output (see Fig. 2.31(a)). 


FIGURE 2.32 
An example of block 
diagram simplification. 
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Finally, we reduce the resulting loop and the two subsystems in parallel to 
obtain: 


Y |) GiG1-GiG3 | Ge. 

U 1- [G1G26/(1 Ta 3 A 
G1G2G5 + G4Gg 

1 — GiG3 - GiG2G4" E 


Mason's Rule for Block Diagram Reduction 

As we have seen, a system of algebraic equations may be represented graphically by 
a block diagram, which represents individual transfer functions by blocks and has 
interconnections that correspond to the system equations. A block diagram is a con- 
venient tool to visualize the system as a collection of interrelated subsystems with 
the relations among the system variables emphasized. An alternative notation to the 
block diagram is given by the signal flow graph introduced by S. J. Mason (1953). 
As with the block diagram, the signal flow graph offers a visual tool representing 
the causal relationships among the components of the system. The method consists 
of characterizing the system by a network of directed branches and associated gains 
(transfer functions) connected at nodes. Several flow graphs and the corresponding 
block diagrams are shown in Fig. 2.33. 

In this book, we will use the block diagram notation that draws a block around 
each gain so there is no chance that a given gain will be associated with the wrong 
branch of the graph. The block diagram has an explicit symbol for the summation 
function to make the output of the node unmistakable. A reduction rule for any 
block diagram was given by Mason (1953, 1956), who related the graph to the 
matrix algebra of the simultaneous equations they represented. We will state the 
rule and illustrate it for several cases, but for the derivation, based on Cramer's 
rule for solving linear equations by determinants, the papers of Mason should be 
consulted. Consider Fig. 2.33(c), where the signal at each node has been given a 
name and the gains are marked. Then the block diagram (or the signal flow graph) 
represents the system of equations: 


X17 X3 tu 

X2 = 81X1 + 82X2 + 84X3 

X3 = §3%2 

Y = AG 

We refer to the internal signals in the diagram, such as the common input to 

several blocks or the output of a summing junction, as nodes. The system input 
signal point and the system output point are also nodes. Mason defined a path 
through a block diagram as a sequence of connected blocks, the path passing from 


one variable to another in the direction of signal flow of the blocks, without in- 
cluding any variable more than once. A signal could traverse through the graph 
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FIGURE 2.33 
Example block diagrams and corresponding signal flow graphs. 


Block diagram Signal flow graph 


(a) 


(b) 


(c) 


EXAMPLE 2.7 
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along a path. A forward path is a path from the input to the output such that no node is 
included more than once. If the nodes are numbered in a convenient order, a forward 
path can be identified by the numbers that are included. Any closed path that returns to 
its starting node is a loop, and a path that leads from a given variable back to the same 
variable is defined as a loop path. Again, a path is a continuous sequence of nodes, 
with direction specified by the arrows, with no node repeating. The source, or input, 
is a node with outgoing branches only and the sink, or output, is a node with incoming 
branches only. The path gain is the product of component gains (transfer functions) 
making up the path. Similarly the loop gain is the path gain associated with a loop, 
that is, the product of gains in a loop. If two paths have a common component, they 
are said to touch. Notice particularly in this connection that the input and the output 
of a summing junction are not the same and that the summing junction is a one-way 
device from its inputs to its output. 

With these definitions, Mason's rule states that the input-output transfer func- 
tion associated with a signal flow graph is given by 


Ys) 1 P 
Gid EET T gon. 


where G; = path gain of ith forward path, the system determinant is A = 1 — > 
all individual loop gains + ò, gain products of all possible two loops which do not 
touch — >` of gain products of all possible three loops that do not touch + ---, and 
the i" forward path determinant, A;, is the value of A for that part of the block 
diagram that does not touch the i" forward path. 


As an example, for the signal flow graph shown in Fig. 2.34, we have 


forward path path gain 
1236 G; = I(V/s)(b))(1); 
12346 G2 = I1(1/s)(1/s)(b2)(1) 
123456 G3 = I(1/s)(1/s)(1/s)(b3)(1) 
loop path 
232 C; = —a i5 


2342 ĉl, = —a js? 
23452 €, = -a Vs? 


The determinants are 


— 1,74! _ 02 Q3 
A=1-(-2-S-S)+0 
Ay = | = (0); 

A, = 1 — (0); 
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FIGURE 2.34 
A block diagram of control canonical form. 


Applying the rule, the transfer function is 


Y(s) _ (bis) + (b2/s*) + (b3/s°) 


U(s) 1+ (a/s) + (az/s2) + (a3/s3) 
bis? + bos + b3 
s? + ajs? + azs + a3 


EXAMPLE 2.8 As another example, consider the block diagram in Fig. 2.35. We have 


forward path path gain 
15 G, = Hj 
12345 G2 — H5HaH;; 


The loop path is 
232 €, = H3Hs; 


The determinants are 


A = 1 — (H3H5); 
A, = 1 — Hà3Hs (note that path 15 does not touch 232) 
A, = 1 — (0); 
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FIGURE 2.35 
An example block 
diagram. 


and the overall transfer function: 


Y(s) _ H(1 — H3H5) + H;H3H4 
U(s) 1+ A3Hs a 


EXAMPLE 2.9 As the third example, consider the block diagram shown in Fig. 2.36. 


forward path gain 
12456 G, = H1H5Hs; 
1236 G2 = H4; 
loop path 
242 €, = H,;Hs; (does not touch €3) 
454 €; = HoH. 
565 £, = H3H7 (does not touch £,) 
236542 4€, = H4H7H6Hs 
determinants 
A = 1 — (H1Hs + H5Hg + A3H7 + HAH5HgH5) + H\H5H3H7); 
A; = 1 - (0); 
A, = 1 — H2Hs; 
Y(s) H,H5H3 + H4 — Hí4H5;Hg 
U(s)  1—-HiHs - HiHs - HH; - HiHgHeHs + H\HsH3H7 m 


Special Case Mason's rule for the special case where the paths are close- 
ly coupled, in that a// forward paths and loop paths touch, can be stated as fol- 
lows: 


The gain of a closely coupled feedback system is given by the sum of forward 
path gains divided by | minus the sum of loop gains. 
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FIGURE 2.36 
Another example block diagram. 


EXAMPLE 2.10 The application of this rule can be illustrated by the block diagram shown in Fig. 


FIGURE 2.37 
An example block 
diagram. 


2.37. In this case, the forward paths and their gains are given by 


forward path gain 
123459 G,G2Gs 
12369 G1Gg 


loop path gain 
2382 G\G3 
23472 G1G5G4 
and the overall gain is given by the rule as 


Y u G,G2Gs5  GjGg 
U l — G1G5 — G1G2G4- E 
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Summary Mason’s rule is useful for solving relatively complicated block 
diagrams by hand. It yields the solution to the graph in the sense that it 
provides an explicit input-output relationship for the system represented by the 
diagram. The advantage as compared to path-by-path reduction is that it is 
systematic and algorithmic rather than ad hoc and problem dependent. However, 
the availability of computer aids makes determination of transfer functions based 
on calculations from state-variable models increasingly attractive (see Chap- 
ter 6). 


2.7.3 Poles and Zeros 


Once the transfer function has been worked out by any of the available methods, we 
are in a position to start the analysis of the response of the system so represented. 
When the equations are simultaneous ordinary differential equations, the transfer 
function that results will be a ratio of polynomials, H(s) = b(s)/a(s). For example, 
suppose 


2s + 1 
HO T E32 p 
then 
l 
b(s)=2s+1= a|s + z): 
and 


a(s) = s +35 +2 
= (s + 1)(s + 2). 


If we assume that b and a have no common factors (this is the usual case), values 
of s such that a(s) = 0 will be places where H(s) is infinity, and these values 
of s are called poles of H(s). They are s = —1 and s = —2 for H(s) of Eq. 
(2.61). On the other hand, values of s such that b(s) = O are places where H (s) 
is zero, and the corresponding s locations are called zeros. There is one zero of 
H(s)ats = —1/2. These poles and zeros completely describe H (s) except for a 
constant multiplier, and one can give a description of a transfer function by plot- 
ting the locations of the poles and the zeros in the s plane, as shown in Fig. 2.38 
for H(s) as given in Eq. (2.66). Since the impulse response is given by the in- 
verse Laplace transform of the transfer function, we call the impulse response 
the natural response of the system, and we can use the poles and zeros to com- 
pute the corresponding time response and thus identify time histories with pole 
and zero patterns. For example, the poles identify the classes of signals contained 
in the impulse response, as may be seen by a partial fraction expansion of H (s). For 
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FIGURE 2.38 

Sketch of s plane 
showing poles as crosses 
and zeros as circles. 


Imaginary 
part of s 


example, we can write 


2s+1 
s?+3s5s4+2 
2s+1 
(s + 1)(s + 2) 
-1 3 
— + —. 
sl s+2 


H(s) 


The poles of this H(s) are at s = —1 and s = —2. From the table of transforms 
in Appendix A, we can look up the inverse of each term in H (s), which will give 
us the time function h(t). In this case, 


h(t) = —e' *3e 7! T— 
= 0 t « 0. (2.67) 


We see that the shape of the component parts of h(t), which are e ' and e, 


are determined by the poles that are at s = —1 and —2. This is true of more 
complicated cases as well, of course, and is the basis for the statement that the shape 
of the natural response is determined by the location of the poles of the transfer 
function. A sketch of these pole locations and corresponding natural responses is 
given in Fig. 2.39, along with complex pole locations, which will be discussed 
shortly. The role of the numerator in the process of partial fraction expansion is to 
influence the size of the coefficient that multiplies each component. 

Because e ?' decays faster than e ', we say that the pole at —2 is "faster" 
than the pole at — 1. Of course, we mean that the signal corresponding to the pole 
at —2 decays faster than the signal corresponding to the pole at — 1, but it is much 
easier to speak of "fast poles" and "slow poles." The point to remember is that 
poles farther to the left in the s plane are associated with natural signals that decay 
faster than those associated with poles closer to the imaginary axis. 


FIGURE 2.39 

Time functions 
associated with points 
in the s plane. 
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Im(s) 


X 
X 


Ne e 


More complicated than the real poles of the previous example are the complex 
conjugate poles given in the transfer function of Eq. (2.68): 


Z5 1 
H(s) = ——————. à 
ts) s+ 2s +5 oe) 
The poles of this transfer function are located at s = —1 + j2, and a partial 


fraction expansion of it can be performed with the result (which the reader should 
verify) of 


H5) = LSU i-o 
& + 1+ f2 So l= 72 
s Ki K; 
|»s$-1-4j2 s-1-j2 
A eJ? A ^g 
aes PR, UG*rfLI-IT ee) 


where Ký is the complex conjugate of Kı. From the table of transforms, as before, 
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the impulse response can be found, which in this case is given by 


h(t) = Se tete i ~ eite" a iz 


= 0 t<0 
A =f | ,—Jj(2t--0) j(2t 40) 

= 5* le +e t=0 

= Ae ‘cos(2t + 0) t=0 

—(0 rS. 


From Eq. (2.69), it is easy to compute that A — 2.06 and 0 — 14.03?. The 
poles of the transfer function leading to Eq. (2.68) are complex, with real part 
— l and imaginary part +2 and —2. In general, with real part —o and imaginary 
part jw, the transient is of the form ae °' cos(wt + 0). Thus, we see that to any 
first-order pole at s = —a there corresponds a natural response to initial conditions 
of the form e ^', and to a complex pole pair at s = +o + jw there corresponds a 
natural response of the form e *?' cos ct. We notice especially that if ø is positive 
(in the right-half plane), the natural response is growing with time, and the system 
is said to be unstable. If o = 0, the natural response neither grows nor decays; 
thus stability is in question, and if ø is negative, the natural response decays, and 
the system is stable. A sketch of the s plane with this correspondence is shown 
in Fig. 2.39. We now look more carefully at the response of a transfer function 
with two complex poles. In the control literature, it is standard to describe the 
second-order transfer function as 
ay? 

: (2.70) 


(ys) = -Amm 
(s) s? + 2f@,5 + we 


The parameter Z is called the damping ratio, and w, is called the undamped natural 
frequency.* The poles of this transfer function are located at a radius c, in the s 
plane and at an angle 0 = sin !£, as shown in Fig. 2.40. 

In rectangular coordinates, the poles are at s = ~o — jwq, where o = £o, 
and wy = wn /1 — £?. When ¢ = 0, we have no damping and w4, the damped 
natural frequency, equals w,,, the undamped natural frequency. For complex poles, 
it is informative to present both the step response and the impulse response. 
Rather than work out the algebra, which is straightforward but tedious and not 
very informative, we present graphs of the responses of the system described 
by the transfer function in Eq. (2.70) for various values of the parameter ¢ in 
Fig. 2.41. Notice that for very low damping the response is oscillatory, while for 
large damping (Z near 1) the response shows very little oscillation. Also important 
to notice is the fact that the curves are plotted with normalized time, being plotted 


*In communications and filter engineering, the standard second-order transfer function is written as 
H = 1/[1 + Q(s/om, + @,/s)]. Here w, is called the band center, and Q is the quality factor. If we 
compare this with Eq. (2.70), we can see that Q = 1/2¢. 


FIGURE 2.40 
s-plane plot for a pair of 
complex poles. 
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versus wnt. Three corresponding pole locations are shown for comparison purposes 
in Fig. 2.42. 


2.7.4 Time-Domain Specifications in Terms of Poles and Zeros 


While the time responses of Fig. 2.41 are informative, they are still almost too 
complex to be remembered. In order to better summarize this important informa- 
tion, we can extract information respecting rise time, settling time, and overshoot 
from these curves in a simpler form. Definitions of these standard features of a 
step response are given in Fig. 2.43. 

Comparing these definitions with the curves of the standard second-order sys- 
tem of Fig. 2.41, we can relate them qualitatively to the pole-location parameters 
é and w,.. For example, the curves with moderate overshoot rise in approximately 
the same time, and, considering the curve for ¢ = 0.5, we notice that the rise 


time from y = 0.1 to 0.9 is approximately w,t, = 1.8. Thus, we can say that 
1.8 
f, = (2.71) 
Wy 


For the peak magnitude M,, which expresses the overshoot, we can be more 
analytical. This value occurs when the derivative is zero, which can be found from 
calculus. The time history of the curves of Fig. 2.41(a) is found from the inverse 
Laplace transform of H(s)/s to be 


oO 


t o . | 
cosogqt + —smMma@yt}, 
Wd 


yt)21l1-e 


where o4 = «o, /1 — 4? and o = £o,. 
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FIGURE 2.41 20 
(a) Step responses of 
second-order ua stems; 
a impulse responses of 
ond-o ide systems 
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FIGURE 2.42 
Pole locations corresponding to three responses of Fig. 2.41. 


Im(s) Im(s) Im(s) 
17.5" 
Re(s) Re(s) Re(s) 
x 
x x 
C=0.707 ¢=0.5 C=0.3 
The derivative of this function is set to zero as follows: 
. =ot Ws -ct : 
y(t) = ce cos eat + Z sina —e “'(—@gtsinwgt + oc cosogt) = 0 
Wd 
m 
=g” H sin@gt + wq sin = 0, 
Wd 
FIGURE 2.43 


Definition of rise time 
t,, settling time ¢,, and 
overshoot Mp. 
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FIGURE 2.44 

Plot of the peak 
overshoot M, versus 
the damping ratio 

& for the second-order 
system. 


which occurs when sinwyt = O, or 
Qqtp = T. (2.72) 


Substituting this value for t, into the expression for y(t), we compute 


^ " RA. 
yip Si+ M, —-1—e 7s [cos + — 3n 
Wq 


= l + e ome 


Thus, we have the formula for the second-order system 


M,=e VIP gxzf«l (2.73a) 
and the approximation 
=|- ES 0= f= 0.6. (2.730) 
0.6 


A plot of this function is given in Fig. 2.44. Two frequently used values from this 
curve are M, = 0.16 for ¢ = 0.5 and M, = 0.04 for ¢ = 0.707. 


Mp% 
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The final parameter of interest from the transient response is the settling time 
t;. This is the time required for the transient to decay to a small value so that 
y(t) is almost in the steady state. Various measures of “smallness” are possible; 
we will use 1% as a reasonable measure here for illustration. In other cases 2% 
or 5% are used. For these percentages, the constant in Eq. (2.74) would change 
accordingly. As an analytic computation, we notice that the deviation of y from 
| is the product of the decaying exponential e ?' and the circular functions sin 
and cos. The duration of this error is essentially decided by the transient expo- 
nential, so we can define (in normalized time) the settling time as that 7, such 
that 


e *^'s = 0.01. 
Therefore, 

4. 

wnt; — 4.6 or t; = : 
CWn 
4.6 

[, = —, (2.74) 

c 


where c is the real part of the pole, as may be seen from Fig. 2.40. 

Equations (2.71), (2.73), and (2.74) characterize the transient response of a 
system having no finite zeros and two complex poles with undamped natural fre- 
quency wn, damping ratio Z, and real part o. In analysis, we can use them to 
estimate rise time, overshoot, and settling time for a system that is adequately 
described as being of this form. In synthesis, we wish to specify t,, Mp, and ts 
and to ask where the poles need to be to satisfy these specifications. In fact, 
we usually want rise time = f,, overshoot = M,, and settling time = fs. 
For specified values of t,, Mp, and ts, the synthesis form of the equations is 
then 


wn = (2.75a) 

¢ = 0.6(1 — Mp) 0<f<06 (2.75b) 
4.6 

g Z 3! (2.75c) 


These equations can be graphed in the s plane, as shown in Fig. 2.45(a), (b), and 
(c), respectively, and will be used in later chapters to guide the selection of pole 
and zero locations to meet control-system specifications for dynamic response. It is 
important to keep in mind that the three parts of Eq. (2.75) are qualitative guides 
and not precise design formulas. 
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2.7.5 Effects of an Additional Zero and an Additional Pole 


Curves such as those shown in Fig. 2.45 are correct for the simple second-order 
system; for more complicated systems they can only be used as guidelines of the 
following kind: If a certain design has inadequate rise time (too slow), we must 
raise the natural frequency. Similarly, if the transient has too much overshoot, then 
damping needs to be increased, and if the transient persists too long, the poles 
need to be moved to the left in the s plane. 


Im(s) Im(s) 
FIGURE 2.45 
Graphs of regions in . 
the s plane delineated by 
Eqs. (2.75) if certain 
transient requirements are 
to be met: (a) rise-time 
requirements; 
(b) overshoot require- Re(s) Re(s) 
ments; (c) settling-time 
requirements; and 
(d) composite of all three 
requirements. 


(b) 


Im(s) Im(s) 
| Re(s) Re(s) 
7 7 


(d) 
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Thus far, only the poles of H(s) have entered into the discussion. Because 
H(s) = b(s)/a(s), there may be finite values of s for which b(s) = 0, and 
these are called the zeros of H(s).* At the level of transient analysis, the zeros 
exert their influence by modifying the coefficients of the exponential terms whose 
shape is decided by the poles. To illustrate this, consider the following two transfer 
functions, which have the same poles but differ in the locations of their zeros. 
They are normalized to have the same gain at s = 0: 


2 


BS) wx Dis t 25 


= = : (2.76a) 


26. 1,1) 
L.l6s EDE + 2) 


2 | 0.1 0.9 
= + 


H»(s) = 


Li\eFi 42 


0.18 1.64 
= eh sae (aroe) 


Notice that the coefficient of the s + 1 term has been modified from 2 in H j(s) to 


0.18 in H2(s). This dramatic reduction is brought about by the zero at s = — 1.1 
in H2(s), which almost cancels the pole at s = —1. Of course, if we put the zero 
exactly at s = —1, this term will vanish completely. 


As an important aside to the issue of dynamic response, this discussion of 
the effects of the several terms on the natural response raises the possibility that 
some term or terms may contribute so small a component to the response that 
they may be omitted and the order of the model reduced, with negligible effect on 
the resulting control-system design. This issue is especially relevant in the study 
of the control of flexible structures. In this case, there are an infinity of dynamic 
modes present, and removing those that have negligible effect is very important. 
In a general transient term, the net contribution is given by the combination of size 
(the numerator coefficients in Eq. 2.76b) and the duration of the term, given by 
the size of the real part of the pole. Suppose we have 


Ri R> R> 
+ 4 — 
s+ Pi s +02 t jo» S +02 — jo»? 


H(s) = 


*We assume that b(s) and a(s) have no common factors. If this is not so, it is possible for b(s) and 
a(s) to be zero at the same location and H(s) to be not zero there. The implications of this case will 
be discussed in Chapter 6 when we have a state-space description. 
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If the contribution of a given term calculated by |R\/o; is much smaller than the 
contribution of other terms, then the negligible term can be replaced by its DC 
gain, Ro/(a2 + jw). In Eq. (2.76b), the contributions are 


0.1 .64 
B. s and ce = 0.82. 


If the smaller term is neglected, the approximation becomes 


H»(s) = 0.18 + SA 

St 

It is important to notice that in this case it is the lowest frequency term that is 
removed. 

To consider the effects of zeros on transient response in order to take them 
into account in design, we consider transfer functions with two complex poles and 
one zero. In order to present the responses in a form easy to remember and to 
plot, we write the transform in a form with normalized time and zero location as 


follows: 
(s/al@,) + 1 
= , d.d 
PAS) = Clon)? + 2104) + 1 a 
The zero is located ats = —aflw, = -—aoc, so, if a is large, the zero is far 


removed from the poles and will have little effect on the response. If a = 1, the 
zero is at the value of the real part of the poles and could be expected to have a 
substantial influence on the response. The step response curves for ¢ = 0.5 and 
for several values of œ are plotted in Fig. 2.46. We see that the major effect of 
the zeros is to increase the overshoot M, with very little influence on the settling 
time. A plot of M, versus a is given in Fig. 2.47. 

It is informative to explain Fig. 2.46 in terms of Laplace-transform analysis. 
To do so, we replace s/w, with s, which means we present the transfer function 
in normalized frequency and the corresponding step responses in normalized time, 
T = Wnt: 


We can write this transfer function as the sum of two terms: 


l l S 


710) E E AE PN 
s) s?+2fs+1 als*+2fs+1 


(2.78) 


The first term is the original (no finite zero) term, and the second term, which is 
introduced by the zero, is a constant (1/a£) times s times the original term. The 


FIGURE 2.46 

Plots of the step response 
of a second-order system 
with an extra zero (i. = 
0.5). 
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(slatw,)+1 ‘ 
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s lon + 2t (slo )--1 


Laplace transform of df/dt is sF(s), so this second term corresponds to adding 
some of the derivative to the original term. The standard term and its derivatives 
are plotted in Fig. 2.48. Looking at these curves, it is fairly obvious why the zero 
increased the overshoot—the derivative has a large hump at the early part of the 
curve, and adding this to A(t) lifts up the response to produce the overshoot. This 
analysis is also very informative in case the zero is in the right-half plane. (This is 
the nonminimum phase case discussed in later sections.) In this case, œ is negative, 
and the derivative term is subtracted rather than added. A typical case is sketched 
in Fig. 2.49. 

In addition to studying the effects of an extra zero, it is useful to consider the 
effects of an extra pole on the standard second-order step response. In this case, 
we take the transfer function to be 


l 


A9) 7. Jalon + DIGAo, + 2£Glo,) * T 


(2.79) 


Plots of the step response for this case are shown in Fig. 2.50 for ¢ = 0.5 and 
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FIGURE 2.47 

Plot of overshoot M, as 
a function of normalized 
zero location a. Ata = 
1, the real part of the 
zero equals the real part 
of the poles. 


m 
D» i 
— 
Ege 


HE HM 


FIGURE 2.48 

Plot of the second-order 
step response and its 
derivative. 


FIGURE 2.49 

Plot of the response of a 
second-order system with 
a right-half plane zero: 

a nonminimum phase 
system. 


FIGURE 2.50 

Plot of step response for 
several third-order 
systems with = 0.5. 
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4 Response of non-minimum 
phase system 
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several values of a. In this case, the major effect is to increase the rise time, and 
a cross-plot of this parameter versus œ is shown in Fig. 2.51. 

From this discussion, we can draw several qualitative conclusions respecting 
the dynamic response of a simple system as disclosed by its pole-zero patterns: 


l. For a second-order system with no finite zeros, the transient parameters are 
approximated by 


i. x l 
Rise time: t, ^ — 
w 


£ 
0.6 


| 0zx£z0.6 


6 


.8 

n 

Overshoot: M, = [ s 

"we 4. 

Settling time: t, ^ — 
c 


FIGURE 2.51 
Plot of normalized rise time for several locations of an additional pole. 


Ont, 


o 2.8 
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2. An additional zero in the left-half plane will increase the overshoot if the zero 


is within a factor of 4 of the real part of the complex poles. A plot is given in 
Fig. 2.47. 


3. An additional zero in the right-half plane will depress the overshoot (and may 
cause the step response to start out in the wrong direction). 


4. An additional pole in the left-half plane will increase the rise time significantly 
if the extra pole is within a factor of 4 of the real part of the complex poles. A 
plot is given in Fig. 2.51. 


Obtaining Models from Experimental Data 


There are several reasons for wishing to obtain a model of a dynamic system to 
be controlled from experimental data. In the first place, the best of theoretical 
model building from equations of motion is only an approximation of the reality. 
Sometimes, as in the case of an essentially rigid spacecraft, the theoretical model 
is extremely good. And sometimes, as in the case of many chemical processes 
such as papermaking or metalworking, the theory is very approximate. In every 
case, before final control design is done, it is important and prudent to verify the 
theoretical model with experimental data. In cases where the theoretical model 
is especially complicated or the science of the process is poorly understood, the 
only reliable information on which to base the control design is the experimental 
data. Finally, the system is sometimes subject to on-line changes, as occurs when 
the environment of the system changes (e.g., an aircraft changes altitude; a paper 
machine is given a different composition of fiber; a nonlinear system moves to a 
new operating point). On these occasions, we need to change the control parameters 
and thus “tune” the controller. In order to do this, it is necessary to have a model 
under the new conditions, and experimental data are often the most effective, if 
not the only information available to do this. 

The experimental data for generating a model are of four kinds: transient, such 
as comes from an impulse or a step; sinusoidal steady state of various frequencies; 
stochastic steady state, as might come from a signal derived from random fluctua- 
tions of electrons (thermal noise) or from some other natural source in the process 
itself; and pseudorandom noise, as may be generated in a digital computer. Each 
of these classes of data has its properties, advantages, and disadvantages. 

Transient response data is quick and relatively easy to obtain. It is also often 
representative of the natural signals to which the system is subjected, and thus a 
model based on such data can be a reliable basis for the design of a control system. 
On the other hand, in order for the signal-to-noise level to be sufficiently high, it 
is necessary for the transient to be highly noticeable. Thus the method is rarely 
suitable for normal operations, and the data must be collected as part of special 
tests. Also, the data is not in a form suitable for standard control-system designs, 
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and the model, such as poles and zeros, must be computed from the data.* This 
computation can be simple in special cases or complex in the general case. 

Frequency response data (see Chapter 5) is simple to obtain but substantially 
more time-consuming than transient response. This is especially so if the time 
constants of the process are long, as often occurs in the chemical process industries. 
As with the transient data, it is important to have a good signal-to-noise ratio, so 
tests to obtain frequency response data can be very expensive. On the other hand, 
as we will see in Chapter 5, frequency response is exactly what is required for one 
of the more effective (Bode plot) methods of control-system design, where, once 
the data is obtained, the control design can immediately proceed. 

Normal operating records are an attractive basis for system model making since 
they are, by definition, nondisruptive and inexpensive to obtain. Unfortunately, the 
quality of such data is very mixed and is worst just when the control is best, for 
then the upsets are minimal and the signals are smooth. Unfortunately, at such 
times some or even most of the system dynamics are hardly excited, and, since 
they contribute very little to the system output, they will not be found in the 
resulting model built to explain the signals. The result is a model that represents 
only part of the system and is sometimes unsuitable for control. In some instances, 
as occurs when one tries to model the dynamics of the electroencephalogram (or 
brain waves) of a sleeping or anesthetized person to locate the frequency and 
intensity of œ waves, for example, normal records are the only possibility. Usually 
they are the last choice for control purposes. 

Finally, the pseudorandom signals that can be constructed by digital logic have 
much appeal. Especially interesting for model making is the pseudorandom binary 
signal, or PRBS. This is a signal that takes on the value +A or —A, according 
to the output (1 or 0) of a feedback shift register. The feedback to the register is 
a binary sum of various states of the register so selected that the output period 
(which must repeat itself in finite time) is as long as possible. With a register of 20 
bits, for example, 27° — 1, or over a million, pulses are produced before the pattern 
repeats. Analysis beyond our scope has revealed that the resulting signal is almost 
like a broadband random signal. And yet this signal is entirely under the control 
of the engineer who can set the level (A) and the length (bits in the register) of 
the signal. Analysis of the data obtained from a test with a PRBS must be done 
by machine, and both special-purpose hardware and programs for general-purpose 
computers have been developed. 


2.8.1 Models from Transient Response Data 
To obtain a model from transient data, we assume that a step response is available. 


If the transient is a simple combination of elementary transients, a reasonable low- 


*Ziegler and Nichols, building on the earlier work of Callender, Hartree, and Porter, use step response 
directly in design of certain classes of processes. See Chapter 3 for details. 


FIGURE 2.52 

A step response 
characteristic of many 
chemical processes. 
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order model can be estimated by hand calculations. For example, consider the step 
response shown in Fig. 2.52. The response is monotonic and smooth. If we assume 
that it is given by a sum of exponentials, we can write 


y(t) = y(~) + Ae * + Be P + Ce Y +.. (2.80) 


Subtracting off the final value and assuming —a is the smallest (slowest) root, we 
write 


y = (e) & Ae?! + 
logio ly — y(%)] = logio A — at logio e 
= logio A — 0.4343ar. (2.81) 


This is the equation of a line. If we fit a line to the plot of log;o[y — y(®)], or 
log[y(%) — y] if A is negative, then we can estimate A and œ. Once these are 
estimated, we plot y — y(%) — Ae ®', computed by subtracting the line Ae ^' 
from the original data. Now we have a curve that is approximately Be ' and on 
the log plot is logo B — 0.434581. We repeat the process until the accuracy of the 
data is lost. The final model step response should be plotted, and then the error 
(residual) should be plotted to estimate the quality of the computed model. Notice 
that we can get a good fit to the step response and yet be far off from the true time 
constants (poles) of the system. However, the method gives a good approximation 
for control of processes whose step responses look like Fig. 2.52. 

An example of this method may make the procedure more clear. Consider the 
data of Table 2.1 taken from Sinha and Kuszta (1983). A plot of this data is given 
in Fig. 2.53. From the line (fitted by eye), the values are 


0.125 


1.602 — 1.167 _ 0.435 
At 


logo |A| 


0.4343a vd Si >a=l. 


y(t) 


1.0 
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TABLE 2.1 
A Set of Step Response t y(t) IO) t y(t) H(t) 
Data l——————————— ee ee ee ee 
0.0 0.000 0.00 1.0 0.510 0.507 
0.1 0.000 | —0.022 1.5 0.700 0.701 
0.2 0.034 0.01 2.0 0.817 0.819 
0.3 0.085 0.068 293 0.890 0.89 
0.4 0.140 0.134 3.0 0.932 0.933 
0.5 0.215 0.206 4.0 0.975 0.975 
1.000 1.000 
Thus 
A= —1,45 
a= 1.0. 
We know that A is negative because y(®) is greater than y(t). If we now subtract 
log|1— 
FIGURE 2.53 gi 
Plot of step response 
data. 


Time t 
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this line from the data and plot the log of the result, we find the plot of Fig. 2.54. 
Here we estimate 


log B = —0.45 
mu Lb ey 
0.43438 = ————— = 2. 
i 0.5 nd 
B s 5.8 
B = 0.35. 


Combining these results, we estimate that 


y(t) = 1 — 13e! + 0.35e ?'', 


Since it is clear that y(0) — 0, we modify the estimates to reflect this constraint 
to find 


S(t) = 1 — 1.34e7' + 0.34e Nr, (2.82) 


FIGURE 2.54 

Plot of 1 = y = Ae™™ 
for step response of 
Table 2.1. 
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From $(t) we compute 


A 1 1.34 0.34 
---— - 
i tj sl s T 5.8 


(s + 1)(s + 5.8) — 1.34s(s + 5.8) + 0.34s(s + 1) 
s(s + 1)(s + 5.8) 
—0.63s + 5.8 
s(s + Ds + 5.8) 


The resulting transfer function is 


—0,63s + 5.8 


Gis) 7 cr DG 4-58) 


(2.83) 
Notice that this method has given us a system with a zero in the right-half plane, a 
fact that may influence the design. This small example has illustrated the sensitivity 
of pole locations to the quality of the data and emphasizes that to use this data 
effectively one must have a good signal-to-noise ratio. 

If the transient response has oscillatory modes, these can sometimes be estimat- 
ed by comparison with the standard plots of Fig. 2.41. The period will give the fre- 
quency c, , and the decay from one period to the next will afford an estimate of the 
damping ratio. If the response has a mixture of modes not well separated in frequen- 
cy, more sophisticated methods such as least-squares identification need to be used. 

Frequency response data, obtained by exciting the system with a set of sinu- 
soids and plotting H(jw), can be used to generate a model. In Chapter 5, we will 
show how such plots can be used directly for design, or how using straight-line 
asymptotes, the frequency response can be used to estimate the poles and zeros of 
a rational transfer function. 

The construction of dynamic models from normal stochastic operating records 
or from the response to a pseudorandom binary sequence can be based either 
on the idea of cross-correlation or by least-squares fit of a discrete equivalent 
model. Both these methods require substantial background we have not developed, 
the presentation of which would take us too far afield at this point. Suffice it to 
say that the field of systems identification is concerned with this problem, and 
many effective methods have been developed. An introduction to the topic is to be 
found in Franklin, Powell, and Workman (1990), Chapter 8, and a comprehensive 
treatment is given in Ljung (1987). 


Summary 


In this chapter we have presented a review of background material essential to 
control-system design. This has included a review of writing the equations of 
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FIGURE 2.55 
Example mechanical 
system. 
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motion for elementary mechanical, electrical, electromechanical, thermal, and fluid 
systems. Because many of these models are nonlinear and the most effective de- 
sign methods are based on linear models, the topic of linearization was presented 
and illustrated with an example of a laboratory experiment in magnetic levita- 
tion. 

With a model in hand, the control engineer needs to be able to analyze the 
response; especially the engineer must be able to predict the qualitative character 
of the response based on the transfer-function poles and zeros. For this purpose we 
have presented the connection between a pattern of poles and zeros and the time 
response. This information has also been used to relate time-domain specifications 
to requirements on pole-zero locations. It is also important for the control engineer 
to be able to interpret the frequency response of dynamic systems and to understand 
the state-variable method of describing control systems. These topics of background 
analysis have been deferred until Chapters 5 and 6, where they will be introduced 
as needed. 

Finally, in recognition of the fact that many dynamic systems needing control 
are described by complex and poorly understood physical principles, the process 
and techniques of obtaining a model from experimental data have been briefly 
described. 


Section 2.2 


2.1 Write the differential equations for the mechanical system shown in Fig. 2.55. 


2.2 Write the equations of motion for a single body of mass M suspended from a fixed 
point by a spring of force constant k. 


2.3 Write the equations of motion of a clock pendulum consisting of a 1-kg bob that may 
be considered to be a point mass suspended from a fixed point by a thin rod of length 
€. How long should the rod be for the period to be exactly one second if we take 
sin@ ~ 0? 


2.4 Write the equations of motion for a pendulum formed by pinning a uniform stick of 
length € and mass M at one end to a fixed point. Assume a torque 7 can be applied at 
the pin. 


ta 
a 


No friction 


92 Chapter 2 / Dynamic Models and Dynamic Response 


Section 2.3 


2.5 Use node analysis to write the equations of motion for the circuits shown in Fig. 2.56. 


a) The lead network. 
b) The lag network. 
c) The notch network. 


2.6 Use node analysis to write the equations of motion of the op-amp circuits in Fig. 2.57. 
Assume ideal operational amplifiers in every case. 


a) A first-order op-amp circuit 
b) A second-order op-amp circuit 
c) The Sallen-Key circuit 


FIGURE 2.56 

Example electric circuits: 
(a) lead, (b) lag, and 

(c) notch circuits. 


(a) 


(c) 


FIGURE 2.57 
Op-amp circuits: (a) first-order transfer function; (b) second-order transfer function; (c) Sallen-key circuit. 


C R4 


(b) 


(c) 
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Section 2.4 


2.7 


2.8 


2.9 


2.10 


The torque constant of a motor is the ratio of torque to current and is often given in 
ounce-inches per ampere. The electric constant of a motor is the ratio of back emf to 
speed and is often given in volts per 1000 rpm. In consistent units, the two constants 
are the same for a given motor. 


a) Show that the units ounce-inch per ampere are proportional to volts per 1000 rpm 
by reducing both to MKS (SI) units. 

b) A certain motor has a back emf of 25 V at 1000 rpm. What is its torque constant 
in ounce-inches per ampere? 


A simplified sketch of a computer tape drive is given in Fig. 2.58. 


a) Write the equations of motion in terms of the literal parameters. K and B represent 
the spring constant and damping of tape stretch, respectively, and w; and «o; are 
angular velocities. 

b) Use the values below and write the equations as a set of first-order differential 
equations (in state form). Use the variables (x i, «,, X2, @2). 


J; = 4X 107? kg - m?, motor and capstan 
B, = 1X10?N : m: s, motor damping 
ri = 2X 10? m 


K, = 3x107?N : m/A, motor torque constant 
K = 2x 10* N/m 

B = 20N/nvs 

r= 2X10?^m 

Jo = 1x10?kg* m" 

Ba = 1XJO?N m- s, viscous damping, idler 
F — 6N, constant force 


X; = tape velocity (variable to be controlled). 


A very typical problem of electromechanical position control is an electric motor 
driving a load that has one dominant vibration mode. The problem arises in computer- 
disk-head control, reel-to-reel tape drives, and many other applications. A schematic 
diagram is sketched in Fig. 2.59. The motor has electrical constant K ,, torque constant 
K,, armature inductance L,, and resistance R,. The rotor has inertia J; and viscous 
friction B. The load has inertia J2. The two inertias are connected by a shaft that has 
spring constant k and equivalent viscous damping b. 


a) Write the equations of motion. 
b) Write the equations as a set of simultaneous first-order equations (state-variable 
form). Use state x = [05050,0,i,]/. 


Assume the driving force on the hanging crane of Fig. 2.9 is provided by a motor 
mounted on the cab and with one of the support wheels on the motor armature shaft. 
The motor constants are K,, K,, and Ra. The wheel has radius r. Write the equations 
of motion for this case. 
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FIGURE 2.58 


Tape drive. x9 
No friction 
Idler wheel 
Jo, Bo 
J1,B1 Take-up 
ri capstan 
F 
Vacuum 
column 
Section 2.5 
2.11 A sketch of a laboratory experiment in fluid (water) flow (two-tank fluid flow) is shown 
in Fig. 2.60. Assume that Eq. (2.36) describes flow through the equal-sized holes at 
A, B, or C. 
a) With holes at A and C and no holes at B, write the equations of motion for this 
system in terms of A; and h2. Assume that h3 is 20 cm and 715 is less than 20 cm. 
When A2 is 10 cm, the outflow is 200 g/min. 
b) At hı = 30 cm and hy = 10 cm, compute a linearized model and the transfer 
function from pump flow (in cubic centimeters per minute) to 7». 
c) Repeat (a) and (b) if hole A is closed and B is opened. 
FIGURE 2.59 


Motor with flexible load. 
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Pump 


FIGURE 2.60 
Fluid flow, two-tank 
problem. 


Section 2.6 


2.12 Consider the network shown in Fig. 2.61; uj, u2 are voltage and current sources, 
respectively; 1 and 2 are nonlinear resistors with characteristics of: 


Resistor 1: i; = G(v)) = vj 
Resistor 2: v = r(i2), 
where the function r is defined in Fig. 2.62. 
a) Show that the equations can be written as: 
X; Gay x.) ug = x3 
X3 = X3 


X3 = x — X2 — r(x3). 


FIGURE 2.61 
A nonlinear circuit. 


FIGURE 2.62 
Nonlinear resistance. 
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Slope=!2 


b) 


c) 


Suppose we have a constant voltage source of 1 V at uw, and a constant current 
source of 27 A; i.e., u? = 1, u} = 27. Find the equilibrium state (x9, x9, x9) 
for the network. Given a particular input u?, the equilibrium state of x? of the 
system is a constant vector such that the system will stay where it started. In terms 
of the state equations, 

Xj X22 x3; = 0. 


Due to disturbances, the initial state (capacitance, voltages, and inductor current) 
is slightly different from the equilibrium and so are the independent sources; that is, 


u(t) = u? + 8u(t) 
x(to) = x°(to) + 8x(to). 


Do a small-signal analysis of the network about the equilibrium found in (a), 
displaying the equations in the form 


0X, = fi 6x + fixa + f136x3 23 giÓu, Je 220U. 


Draw the circuit diagram that corresponds to the linearized model. Give the values 
of the elements. 


2.13 Consider the network in Fig. 2.63 with a nonlinear conductance G, where ig = 
g(vg) = volvo — 1)(vG — 4). The state differential equations are 


di ] 
mo 

dv . 

7 = =] + ele = v), 


where i and v are the states and u is the input. 


a) One equilibrium state occurs when u^ = | is i; = v; = 0. Find the other two 


pairs of v and i that will produce equilibrium. 


b) Find the linearized model of the system about the equilibrium point u* = 1, i* = 


y; = 0. 


c) Find the linearized models about the other two equilibrium points. 
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FIGURE 2.63 
Nonlinear circuit for 
Problem 2.13. 


2.14 Show that we can scale the variables so that the equations of motion for the “stick- 
on-a-cart” problem given in Eq. (2.15) can be written as 
ð= O+u 
y= 0-u, 
where u is a force input. 


a) Draw a block diagram of this system with u as the input and y as the output using 
only integrators as the dynamic elements. 

b) What is the transfer function from u to y? (Be careful with the positive feedback 
loop.) 


O 2.15 Consider the single-spool turbojet described by, 


x = Fx + Gu 
y = Hx, 
where 
X1 -— 5 ENS E- D 
x = is i | G H H =[0.1 18] 
xı = Rotor Speed (rpm), 
x2 = Tailpipe Pressure (psi), 
u = Fuel Flow (pph), 
y = Thrust (lbs). 
The scaling matrices are 
D 15760 rpm 0 
" 0 27psi 
D, = 1770 pph 
D, = 2062 lbs. 


Compute the normalized system matrices. 
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2.16 
2.17 


2.18 


2.19 


2.20 


2.21 


2.22 


2.23 


2.24 
2.25 


2.26 


2.27 


Compute the poles and zeros of the turbojet engine described in the previous problem. 


Compute the transfer functions for the circuits in 


a) Fig. 2.56(a) 

b) Fig. 2.56(b) 

c) Fig. 2.56(c) 

d) Fig. 2.57(a) 

e) Fig. 2.57(b) 

f) Fig. 2.57(c) 

Compute the transfer function from motor voltage to position @ for the system in Fig. 
2.59, 


Compute the transfer function from motor current to tape tension for the tape drive 
with the values given in Fig. 2.58. 


(Computer problem) Compute the poles and zeros of the tape drive transfer function 
from current to position. 


Compute the transfer function for the two-tank problem of Fig. 2.60 with holes at A 
and C. 


Consider the second-order system with the transfer function, 


3 
Gu eia e 
a) Determine the DC gain for this system. 
b) What is the final value of the step response of this system? 


a) Compute the transfer function of the block diagram shown in Fig. 2.64 by Mason's 
rule. 

b) Write the third-order differential equation that relates y and u. (Hint: Consider the 
transfer function.) 

c) Write three simultaneous first-order (state-variable) differential equations using vari- 
ables xı, x2, and x3, as defined on the block diagram in Fig. 2.64. Notice how 
the same constant parameters enter the transfer function, the differential equations 
and the matrices of the state variable form in this case. Because of these simple 
relationships, the system is said to be in control canonical form. 


Find the transfer function for the block diagrams in Fig. 2.65. 


Find the transfer functions of the block diagrams in Fig. 2.66(a), (b), (c), and (d) by 
the rules of Fig. 2.30 and Fig. 2.31. 


Find the transfer functions of the block diagrams in Fig. 2.66(a), (b), (c) and (d) by 
Mason's rule. 


Consider the system shown in Fig. 2.67: 
Let 


K(s +z) 


me) (sp). 


e (s -- 3)s Gels} = 


100 Chapter 2 / Dynamic Models and Dynamic Response 


FIGURE 2.64 
Control canonical form 
block diagram. 


2.28 


2.29 


Find K, z, and p such that the closed-loop system has a 5% overshoot to a step input 
and a settling time of 4/3 s (1% criterion). You may start with z = 3, but it is 
not acceptable as the final answer. (Note: Theoretically you can achieve the transient 
response specifications exactly. ) 


Given the following G(s), sketch the step response based on the locations of the poles 
and zeros. 


s/2+ 1 


G(s) = (404+ DIG/AY +5441] 


Draw the region in the s plane that corresponds to meeting specifications on the peak 


time t, < t),, where t, has been specified. 


2.30 The open-loop transfer function of a unity negative feedback system is 


2.31 


K 


le s(s +2) 


The system response to a step input is specified as follows: peak time 7, = 1 and 
percent overshoot M, = 5%. 


a) Determine whether both specifications can be met simultaneously by selection 
of K. 

b) If the specifications cannot be met simultaneously, determine the value of K such 
that both specifications are relaxed by the same percentage. 

c) Sketch the associated region in the s plane. 


Consider the system described by the single loop shown in Fig. 2.67. It may be 
imagined as a system with an infinite number of paths. One path passes directly 
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FIGURE 2.65 
Example block diagrams. 


(c) 


through the node. The other path goes through the loop once before leaving. The third 
path goes through the loop twice before leaving and so on. Determine the transfer 
function from this interpretation of the loop. 


2.32 Show that for a second-order system, the initial condition response is given by 
e ?' 

———— sin (eat + cos! £], 

Jl -£* 


Prove that for the underdamped case (i.e., ¢ < 1), the response oscillations decay at 
a predictable rate (see Fig. 2.68) called the logarithmic decrement (6), where 


y(t) = yo 


6 = m=] = OT 
J1 

A Ay; 

= qn acq 
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FIGURE 2.66 
Block diagrams for Problems 2.25 and 2.26. 


(c) (d) 


FIGURE 2.67 r(s) 
A unity feedback system. 


FIGURE 2.68 
Definition of logarithmic 
decrement. 
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2.33 Consider the two nonminimum phase systems, 


-Asn 
uL SM EDUC 3] 
D diy e 


(s + 1)(s + 2)(s + 3) 


a) Sketch the unit step responses for G(s) and G(s), paying close attention to the 
start of the response. 

b) Explain the difference in the behavior of the two responses as it relates to the zero 
locations. 

c) Consider a stable strictly proper system (i.e., m zeros, n poles, m < n). Let 
y(t) denote the step response of the system. The step response is said to have an 
"undershoot" if it initially "starts off in the wrong direction." Prove that a system 
such as the one described has an undershoot if and only if its transfer function has 
an odd number of real right-half plane zeros. 


2.34 Consider the second-order system with an extra pole 


2 
wP 


US Paes pXs? + 2fo,s + w2?) 


Show that the unit step response is 


y(t) = 1+ Ae” + Be” sin(wat — 0), 
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Amplitude 
FIGURE 2.69 
Time to double. 
2A 
A 
0 
-Å 
where 
=g 
A — n 
w? = 26H np F p? 
Be 
JP? = 2p? = Konp + i) 
J1-2 nvl—f? 
0 = tan! ving + tan! 1 i 


-— p— Cw, 


a) Which term dominates y(t) as p gets large? 
b) Give approximate values for A and B for small p. 
c) Which term dominates as p gets small? (Small with respect to what?) 


2.35 A measure of the degree of instability in an unstable aircraft response is the amount of 
time it takes for the amplitude of the time response to double (see Fig. 2.69). Show 
that for a first-order system the time to double (72) is 


where p is the pole location in the RHP. Similarly, show that the time to double for a 
second-order system (with two complex poles in RHP) is 


dq = . 
— wn 


Section 2.8 


2.36 Samples from a step response are given in Table 2.2. Plot this data on a linear [y(t) 
vs. t] and semilog [log(y — Yæ) vs. t] scale and obtain an estimate of the transfer 
function. 
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TABLE 2.2 t y t y 


Basic 


Principles 


of Feedback 


The typical control problem begins with a physical dynamic system that has an 
output that is required to follow some externally-set desired path over time and has 
a control input that can be set by the designer. The reference path may be a constant, 
in which case the problem is called one of regulation, or the reference path may vary 
in some unforeseen way, in which case the problem is one of track following. In the 
generic case, the output is prevented from matching the reference exactly because ex- 
ternal disturbances that are present influence the controlled output and also because 
the equations of motion of the system are not known perfectly, so that the designer 
cannot compute exactly what the effect of a given control action may be. There are 
two basic system structures for achieving control of dynamic systems: open-loop con- 
trol, as shown in Fig. 3.1, and closed-loop control, as shown in Fig. 3.2. Notice that 
closed-loop control requires introduction of an output sensor, which usually brings 
noise as well as a measure of the output variable. In this chapter, we will compare 
these two structures from the point of view of their effectiveness in keeping the sys- 
tem error small in the face of disturbances and model errors. We also will explore 
the consequences of control on the dynamic response of the system. 

We begin with a case study using speed control to illustrate the properties of 
feedback and open-loop control. We consider first constant gain controllers, which 
in the process industries are given the name proportional control. We next show 
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FIGURE 3.1 
Open-loop control 
system. 


3.1 


FIGURE 3.2 
Feedback control system. 


Output 
Q 


Control 
Reference Controll Process or 
input ontroner plant 


how integral control can be introduced to obtain improved steady-state tracking 
properties, and finally how derivative control can correct some of the bad side 
effects of integral control. Considered together, these are called PID control and 
constitute the elementary heuristic approach to controller design, which has found 
wide acceptance in the process industries. Before leaving this introduction to the 
advantages of feedback, we consider the general case of steady-state tracking of 
polynomial reference inputs. In the final section, we consider the definition of 
system stability and Routh’s test, which can determine if the roots of a characteristic 
equation are all in the left-half plane. 


A Case Study of Speed-Control 


Equations (2.27) and (2.28) describe the dynamics of a DC motor. If we assume 
that we can neglect the armature inductance and the shaft compliance, the equation 
in terms of motor speed is 


, K,K, K, 
Q + Q = —v,+Te, 3.1 
J R, R, Va + Te (3.1) 
where 
Q = rotor speed (Ôm), 
J = shaft inertia, 
Te = load torque. 


By redefining constants, the equation can be simplified to 


TQ +Q = Ko(va + KiTe), (3.2) 
where 
T = JR,/K;K,, 
Ko = LK os 
Kı = R,/K;. 
Control 
Reference Output 


input 
input O g} Controller Process 
fat 


FIGURE 3.3 
Feedback speed-control 
system. 


3.1 / A Case Study of Speed-Control 109 


These equations are described by the block diagram seen in Fig. 3.3. The 
output sensor is a tachometer, which is usually a small, permanent-magnet, DC 
machine that produces a voltage proportional to the shaft speed, Q. The controller 
is an electronic amplifier of gain K, which produces a voltage proportional to the 
difference between the voltages that represent the reference speed, (),, and the 
motor speed, Q. A very similar block diagram would result for many different 
types of speed-control systems. For example, in a steam engine controlled by a 
flying-ball governor, the centrifugal weights are the speed sensor, and their motion 
directly operates a valve (the controller) that changes the steam supplied, which in 
turn changes the speed of the engine. 


3.1.1 Disturbance Rejection 


Let's compare feedback control and open-loop control with respect to how well 
they maintain a constant set reference speed in the face of load or disturbance 
torques. For the open-loop controller, the amplifier voltage is taken to be 


va = Kalp (3.3) 


The gain, K., is determined so that the output speed equals the reference 
speed when the load torque is zero. From the equation, this value is easily found 
to be 


l 


Ke = =>. 
c Ko 


In steady state (Q = 0) and with no load torque (T; = 0), the output speed is 


l 
Q = Kova = Ko— Q., — I. 
Ko 
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In the feedback controller, the amplifier output voltage is taken to be 
Va = K(K,Q, — K,Q). (3.4) 


Because the control effort is proportional to the speed signals, this is called propor- 
tional control. Combining the motor model given by Eq. (3.2) with the feedback 
controller added according to Eq. (3.4), the formulas for the (closed-loop) sys- 
tem are 


TQ + (1 - KKK5)Q = Ko(KK,Q, + KT). (3.5) 
For no load torque (T; — 0), the steady-state (Q — 0) value of speed is 


KoKK, 

The gains K, K,, and Ky are selected so that Q = Q,. Usually the sensor and 
amplifier gains are selected for performance, and the reference gain set by the 
formula K, = (1 + KoKKy)/KoK. At this point, it appears that both approaches 
provide the desired result— specifically, Q = Q, in the steady state. The gains 
have been set with zero load-torque; let's compute what effect a nonzero torque 
will have on the steady-state speed in the two cases. Equations (3.2) and (3.3) 
show that in the open-loop system the steady-state speed is 


Q = Ko(K.Q, + K,Te). 
Hence, with Ke = 1/Ko, the speed with load torque is 
Q = Q, + KoKiTe, 
and the variation in speed caused by the load torque is 
6Q = KoKiTe. (3.7) 


So we see that the speed error is proportional to the disturbing load, and the control 
designer has no influence over the parameters (K; and Ko) that determine the 
error. 

For the feedback case (Eq. 3.5), the steady-state speed for a constant Q, and 
Te becomes 


KoK K, KoK, 


"NE ee E. E 3.8 
1+KoKKy 1+KoKKy ' diu 


If it is possible for the designer to pick K so that KoKKy œ> 1 and KK; > 
Kı, no significant error will result with a disturbing load torque. In fact, as long 
as KoKK; > 0, comparison of Eqs. (3.7) and (3.8) reveals that the feedback- 
controller speed errors due to a load torque will be less than the open-loop speed 
errors by exactly 1 + KoK K y. This is our first conclusion about feedback: System 
errors are less sensitive to disturbances with feedback than they are in open-loop 
systems. 
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\ 


3.1.2 Effects of Gain Changes 


As another comparison of open- and closed-loop control, let’s suppose the motor 
gain Ko drifts from its original value to a value of Ko + 6Ko. In the open-loop case, 
the controller gain remains Ke = 1/Ko, and the new steady-state speed would be 


l ôKo 
Q — K + ôK — Q., == ] + — D. 
(Ko ora ed 
The speed error is 
ôKo 
ôQ = ——Q,. 
Ko 
In terms of percent changes, this is 
60, ôKo 
— = |—. 
Q, Ko (s 9) 


This means that a 10% error in Ko would yield a 10% error in Q. 
Applying the same change in Ko to the feedback case (Eq. 3.6) yields the new 
speed 


(Ko + 6Ko)KK, 
1+(Ko+6Ko)KKy ' 


We would like to express this speed in terms of 6Ko, which we do by expanding 
the expression in a series, as follows. First, we arrange the denominator to be of 
the form | + x, where x is small: 


_ [KoK K,/(1 + KoKKy)] + [KK,6Ko/(1 + KKoKy)] 


s 1 + [KK ;6Ko/(1 + K KoK y)] zi 
Now 
l 
i+x EA 
so with x = K;KóKo/1 + KKoK y), 
ry te KoKK, KK,6Ko | | _ KK;60Ko 
| - KoKK; 1+KKoKy 1 - KKoKy] 
Ignoring the second power of 6K, and defining 
_ 1+ KKoKy 
i K Ko 
as before, we find 
l ôKo 
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Thus 
l ôKo 
6 = 0, ————— —, 
] + K KoK; Ko 
or 
o l ôKo 


íl; 1+ KKoKy Ko ` ame 
Here we see that a 10% change in Ko will cause only a 1/(1 + KKoKy) X 10% 
change in the speed Q, and this is very small if K KoK ; > 1. 

Bode called the ratio of 50/0 to 6Ko/Ko the sensitivity of the gain from Q, 
to Q with respect to Ko. We can compute this result rather more directly if we 
use differential calculus. Suppose for the moment we set Ky = K,.= 1, and the 
transfer function is 


K Ko 
T(Kg) = ———. 
Pales K Ko 
To the first order, the variation is the derivative, so 
dT 
ôT = ——óKo, 
dKy 


and 


/ 


ôT Aas Ko dT | 6Ko 
T T dKo!} Ko 
— (sensitivity) wed! 
y Ko s 
Direct calculation gives, for 
|. KKo 
1+ K Ko 
then 


Sk = sensitivity of T with respect to Ko 


A Ko dT 
- UP dE 
"an Ko (1+KKo)K — KKo(K) 
Ke 7 KR + KK) (L+ EK 
]* 
EETA 


*The factor 1 + K Ko occurs so frequently in feedback design that Bode named it the return difference 
of the feedback path. 
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This result exhibits another major advantage of feedback: The error in the 
controlled quantity is substantially less sensitive to variations in the gain of the 
plant in a feedback loop than when control is done by the open-loop controller. 
Therefore if the system gain is subject to change, it is still possible to achieve 
precise control if feedback is used. This is often very important when the system 
being controlled — for example, an electric motor or steam engine— is a large, high- 
power device whose gain is not only difficult to compute but is naturally subject 
to substantial variations. The superiority of feedback control would be equally 
apparent if we considered errors in the control gain K. This is so because this gain 
always appears as a product with Ko; therefore, the analysis for a Ko error applies 
directly for an error in K. 


3.1.3 Dynamic Tracking 


The two features we have looked at thus far have been steady-state properties in 
the presence of constant reference and constant disturbance. The systems we are 
interested in are dynamic, and the tracking of time-varying inputs is an important 
role for control. It is also true that the dynamics of the system are changed by 
feedback. A constant-gain, open-loop controller has no effect on the dynamics of 
the system for either reference or disturbance inputs. If the open-loop controller 
includes a filter to change the response to the reference, the filter is in series with 
the dynamics of the plant, and the unchanged plant dynamics will still determine 
the response to disturbances. In the case of the speed control, Eq. (3.2) shows that 
the simple first-order plant dynamics are described by the time constant 7. The 
dynamics with feedback control are described by Eq. (3.5), and the root of the 
characteristic equation of this system is at 


1 KKK; 
ed 


Therefore, the time constant 7/(1 + K KoK ;) becomes smaller (faster) as the feed- 
back gain K is increased. It is often true in this way that closed-loop systems 
become faster as the feedback gain is increased, and if there are no other effects, 
this is generally desirable. As we will see, higher-order systems typically become 
less well damped and possibly even unstable as the gain increases. Thus, a limit 
exists on how high the gain can be made in an effort to reduce the effects of dis- 
turbances and plant parameter changes. An early solution to improve steady-state 
control without extremely high gains was provided by the introduction of integral 
control. 


Integral Control 
To see the effects of integral control, we return to Eq. (3.2) and let the voltage be 
the integral of the error between Q and Q,, as follows: 


yy = «| (11, — Dd». 
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FIGURE 3.4 
Locus of roots of Eq. 
(3.13) vs, K. 


In this case, we set K, = Ky and include them in the general K. With this choice, 
the equation of motion is 


7. +Q = Kolk | (Q, — O)dn + K,T,]. (3.11) 


To remove the integral in Eq. (3.11), we differentiate once to obtain 
TÜ +Ô = KoK(Q, — Q) + KoKiTe 
TQ +Q + KoKQ = KoKQ, + KoKi Te. (3.12) 
We can see from this equation that several limitations of proportional control 
have been removed. If the load torque is a constant, then T; = 0, and the response 


to this class of load disturbance is completely eliminated. Furthermore, if the 
reference speed is a constant, the steady-state speed is given by 


KoKQ = KoKQ),, 


and the motor speed equals the reference speed regardless of the value of Ko! We 
need to consider what integral control does to the dynamic response. For this, we 
need to look at the characteristic equation corresponding to Eq. (3.12), which is 


Ts? +s +KoK = 0. 
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The roots of this equation, which are readily computed, vary as the control gain 
K is changed. In fact, it is informative to compute these and to plot them as a 
function of K. By the quadratic formula of algebra, the roots are 
=] + Jl-—4KgoKT 
s= ————— (3.13) 
2T 

and are plotted in Fig. 3.4 for changing values of the gain K. When the gain is 
zero, the roots are at — 1/r and at 0. As the gain is raised, the roots move together 
until there is a double root at — 1/27 and then, for higher gains, the roots remain 
at the same real value while the imaginary part gets larger and larger. Thus, as 
the integral gain is raised, the damping of the roots becomes less and less.* If the 
designer wishes to increase the dynamic speed of response with large integral gain, 
the response becomes very oscillatory. A way to avoid this behavior in some cases 
is to use both proportional and integral control at the same time. 


Proportional Plus Integral (PI) Control 
With both proportional and integral control, the control voltage for our example 
problem becomes' 


Va = |o, - Q) + | (Q, —Q)dn 


I 
In this form, the terminology is to call the parameter K the “proportional gain” and 
to call the parameter 7; the integral or reset time. If we substitute this expression 


for the voltage into Eq. (3.2) and differentiate again to remove the integral, the 
equation of motion this time is 


TQ +O = Ko[K((Q, — Q) + mo, —0)}+ KiT;] (3.14) 


As with integral control, if both the disturbance torque and the reference speed are 
constant, the steady-state speed is exactly equal to the reference speed, regardless 
of the plant gain Ko. The characteristic equation corresponding to Eq. (3.14) is 


Ts? + (1 + KoK)s + KoK/T; = 0. 


It can be seen that by choice of K and T; the designer can independently set val- 
ues for the coefficient of s and for the constant term and thus has independent 
control over the damping ratio and the natural frequency of the roots. PI control 
is enough for our simple case study example; the motor will keep an exact match 
to the constant reference speed in spite of the constant load torque and regardless of 


*This kind of plot, a plot of the roots of the characteristic equation as one parameter is changed, is 
extremely useful and was developed into a major design tool by W. Evans. He called the plot a root 
locus. We will study Evans’ technique in some detail in Chapter 4. 


t Many designers omit the Q, in the proportional term so Q ,. does not appear in Eq. (3.14). 
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A2 


FIGURE 3.5 
Simple feedback control 
block diagram. 


small changes in the motor gain Ko. Furthermore, the designer has complete control 
over the coefficients of the characteristic equation. For higher order systems, it is 
necessary to introduce another term in the equation, derivative control, to give 
more control over the dynamics. The result is called the “three-term controller,” 
PID control. 


Types of Feedback 
3.2.1 Proportional Feedback 


When the feedback control signal is made to be linearly proportional to the error 
in the measured output, we call the result proportional feedback: This is the case 
for the feedback (Eq. 3.4) in the controller in Section 3.1. The general form of 
proportional control is 


u= Ke, 


and, therefore, the D(s) in Fig. 3.5 is 


D(s) = K. 
An arbitrary second-order plant, 
G(s) — : 
s? +as +b’ 


with proportional feedback yields a closed-loop characteristic equation: 
s$ +as+b+K =0. (3.15) 


Had the plant been a spring-mass system such as shown in Fig. 3.6, the feedback 
would provide a control force that would act as if it were an additional spring and 
would increase the speed at which the system returned to its neutral position. If 
the system had b = O (that is, no spring) it would have no tendency to return to 
the neutral position; thus feedback is essential to its return. 


FIGURE 3.6 
Spring-mass system. 


FIGURE 3.7 
Locus of roots of 
Eq. (3.15) vs. K(b = 0). 
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This can be seen by inspecting the roots of Eq. (3.15), with b = Oasa 
function of the feedback gain K. The solution is given by 


pec (ay x 


and is plotted in Fig. 3.7. It shows that the root at s = O for the open-loop case 
(K = 0) moves increasingly to the left for increasing values of K(0 < K < a?/4), 
which implies a decreasing time constant for the system. For values of K > a?/4, 
the real part of the roots do not change with K; but the imaginary part increases 
with K, and thus the rise time of the system decreases. However, a decreasing 
damping ratio goes along with the faster response. For higher-order systems, very 
large values of the proportional feedback gain can often lead to instability. For 
most systems, there is typically an upper limit on the proportional feedback gain in 


118 Chapter 3 / Basic Principles of Feedback 


order to achieve a well-damped, stable response. This example is typical of most; 
proportional feedback, at the least, increases the speed of driving the error to zero 
and in some cases is essential for eliminating the error. 

Increasing the value of K increases the magnitude of DG, which was shown in 
Section 3.1 to be instrumental in reducing the errors of the system. We see here that 
the dynamic response often places a limit on how high K can be made; therefore 
there is a limit on how much the errors can be reduced by using proportional 
feedback only. 


3.2.2 Integral Feedback 


As shown in Section 3.1, integral feedback has the form 


where T; is called the integral, or reset, time and 1/T, is referred to as the reset 
rate. This feedback has the primary virtue that it can provide a finite value of u 
with no error-signal input e. This comes about because u is a function of past 
values of e rather than of the current value, as in the proportional case. Therefore 
past errors e will “charge up" the integrator to some value that will remain, even 
if the error becomes zero. This feature means that disturbances w (see Fig. 3.5) 
can be accommodated with zero error because it is no longer necessary for e to be 
finite to produce a control that will negate the (constant) disturbance w. Another 
way of seeing this is to note that it is now possible for D to have an infinite gain, 
which would yield a zero y response to a disturbance w. 

The primary reason for integral control is to reduce or eliminate steady-state 
errors, but this benefit typically comes at the cost of reduced stability. For example, 
consider the speed controller discussed in Section 3.1. Replacing the proportional 
feedback in Eq. (3.4) with integral feedback yields 


K 
Va(s) x T,; Vr zT Q), 


which, when combined with Eq. (3.2), produces the characteristic equation 


Ts +s + =o e 0. 
T, 
Increasing the gain K/T; of this system will ultimately result in lightly damped 
roots, as is the case for the solution of Eq. (3.15) for large values of K. However, 
the speed controller with proportional feedback was shown to yield roots on the 
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negative real axis for any value of the proportional feedback gain K . In general, any 
system will be made less stable or less damped by the addition of integral control. 
This characteristic will be discussed in more depth in the following chapters. 


3.2.3 Derivative Feedback 
Derivative feedback (or rate feedback) has the form 
u(t) = KTpe. 
Therefore the D(s) in Fig. 3.5 becomes 
D(s) = KTps, 


and Tp is called the derivative time. 

It is typically used in conjunction with proportional and/or integral feedback 
to increase the damping and generally to improve the stability of a system. Unless 
the system has a natural proportional term such as a spring or equivalent feature, 
derivative feedback by itself will not drive the error to zero. 

Let’s reexamine the system in Fig. 3.6, this time without the spring. The 
characteristic equation with D(s) = KTps becomes 


s? + (a+KTp)s = 0, 
which has roots at 
$ = 0, m + K,Tp). 


The root at s = 0 remains there independent of the value of KTp and signifies 
that any initial condition on y will not have the tendency to go to the commanded 
value. However, the feedback does affect the rate at which initial y values decay 
to zero. 


3.2.4 PID Controllers 

Feedback that has three terms—proportional plus integral plus derivative—is re- 
ferred to as PID control. In the generic unity-sensor-gain topology shown in Fig. 
3.5, the controller transfer function is given by 


D(s) = KI + x3 + Tps| E(s). (3.16) 
T,s 


As suggested at the end of our consideration of the simple first-order case study 
of speed control, the PID combination is sometimes able to provide an acceptable 
degree of error reduction simultaneously with acceptable stability and damping. 
These controllers have been found to be so effective that PID is the standard con- 
trol action in the process industries, such as petroleum refining, paper making, 
metal forming, and so on. To design a particular control loop, the engineer merely 
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FIGURE 3.8 
Response of a second-order system G(s) = l/[(s + 1)(5s + 1)] to a unit disturbance W. 
Tr=2 

Kp=19 

Tp=4/19 


Error e(t) 
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has to adjust the three constants in Eq. (3.16) to arrive at acceptable performance. 
The adjustment process is so common that it is called “tuning” the controller. 
Criteria for tuning are based on the ideas presented in the case study: Simply 
stated, increasing K and 1/T; tend to reduce system errors but may not be capable 
of also producing adequate stability, and increasing Tp tends to improve stability. 
Figure 3.8 illustrates the effect of the proportional, PD, and PID feedback on 
the step response of a second-order plant. The figure shows the reduced oscillatory 
behavior brought on by addition of the derivative term, and the increased oscillatory 
behavior but lower error brought on by the integral term. 


o Ziegler-Nichols Tuning of PID Regulators 


As we will see in later chapters, sophisticated design methods are available to 
develop a controller that will meet steady-state and transient specifications for 
both tracking input commands and rejecting disturbances. These methods require 


FIGURE 3.9 
Process reaction curve. 
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y(t) 


: K 
/Slope R= — = reaction rate 


AK 


complete models of the dynamics of the process to be controlled in the form of 
equations of motion or transfer functions. Callender et al. (1936) attempted to 
select a class of common systems dynamics and widely used PID controllers and 
to specify satisfactory values for the controller settings, based on estimates of the 
plant parameters that could be made by an operating engineer from experiments 
on the process itself. Ziegler and Nichols recognized that the step response of 
most process control systems has the general S-shaped curve shown in Fig. 3.9, 
which is called the process reaction curve and can be generated experimentally or 
from dynamic simulation of the plant. The shape of the curve is characteristic of 
high-order systems, and the plant input-output behavior may be approximated by 


rs): Eg 
U(s) ts +1 


which is simply a first-order system plus a transportation lag.* The constants in 
the above equation can be determined from the unit step response of the process. 
If a tangent is drawn at the inflection point of the reaction curve, then the slope of 
the line is approximately R = K/7, and the intersection of the tangent line with 
the time axis identifies the time delay L = tg. If the actual plant output does not 
fit this sample model very well, other poles may be added. However, the model 
will most probably be adequate to provide a first attempt at controller design. 
Ziegler and Nichols gave two methods for tuning the controller. In the first 
method, the choice of controller parameters is based on a decay ratio of approxi- 
mately 0.25, which means that a dominant transient decays to a quarter of its value 
after one period of oscillation, as shown in Fig. 3.10. A quarter decay corresponds 
to ¢ = 0.21 and is a good compromise between quick response and adequate sta- 
bility margins. The equations for the system were simulated on an analog computer, 
and the controller parameters were adjusted until the transients showed a decay of 


*' The transfer function, e 4^, corresponds to a signal delay in time. Physically this usually occurs 
because some material must be transported from one place to another. Hence the name, transportation 


lag. 
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FIGURE 3.10 
Quarter decay ratio. 


TABLE 3.1 
Ziegler-Nichols Tuning 
for the Regulator, 

D(s) = 

K(1 + qt; + Tos), for 
a Decay Ratio of 0.25 


| | 
l¢——— Period ——— 


25% in one period. The regulator parameters suggested by Ziegler and Nichols are 
shown in Table 3.1. 

In the second method, the criteria for adjusting the regulator parameters are 
based on evaluating the system at the limit of stability. Using only proportional 
control, the gain is increased until continuous oscillations are observed, that is, until 
the system becomes marginally stable. The corresponding gain K, (also called the 
ultimate gain) and the period of oscillation P„ (also called the ultimate period) are 
determined as shown in Figs. 3.11 and 3.12. This period should be measured when 
the amplitude of oscillation is quite small. Then one “backs off” from this gain, as 
shown in Table 3.2. These parameters can be easily computed from a limit cycle 
under relay control (see Section 4.6.4). 

Experience has shown that the controller settings according to Ziegler-Nichols 
rules provide a good closed-loop response for many systems. The final tuning of 
the controller can be done manually by the process operator to yield the "best" 
control.* 


* For a recent revisit, see Hang, Astrém, and Ho (1990). 


Type of Controller Optimum Gain 
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FIGURE 3.11 
Determination of the 
ultimate gain and period. 


FIGURE 3.12 
Marginally stable system. 
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Integrator Antiwindup: A Taste of the Practical World 
The dynamic range of practical actuators is usually limited; for example, a valve 
saturates when it is fully open or closed, and the control surfaces in an aircraft 
can be deflected only to a certain angle from their nominal positions. If integral 
control is used with such actuators, a phenomenon known as integrator windup* 
may occur. In the event of large commands, the integrator builds up a large value, 
which results in large overshoots and errors. Consider the feedback system shown in 
Fig. 3.13. Suppose a large reference step causes the actuator to saturate at u max. The 
integrator keeps integrating the error e, and the signal u, keeps growing. However, 
the input to the plant is still at its maximum value, namely, u = Umax, and the 
error remains large. The increase in ue is not helping anything, as the input to the: 
plant is not changing. The integrator output may become quite large if saturation 
lasts a long time. It will require considerable error to discharge the integrator to its 
proper value. 

As an example, consider the first-order plant with a proportional-plus-integral 
(PI) regulator, 


u = K i (3.17) 


1 t 
e + — | e(t)dt 
Ti i : 


and a control that saturates at +1. With the system at rest, an input of size 1 will 
cause the error to equal 1, the control to saturate, and the integral action to be- 


* [n process control, this is usually referred to as reset windup, since integral control is also called reset 
control. The term also arises because, with no integral control, a given setpoint of, say 10, results in 
a response of less value, say 9.9. The operator must then "reset" to 10.1 to bring the output to the 
desired value of 10. With integral control, the controller automatically brings the output to 10 with a 
setpoint of 10; hence the integrator does the reset. 
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TABLE 3.2 


Ziegler-Nichols Tuning Type of Controller ^ Optimum Gain 
for the Regulator, ey 


D(s) = K(1 + Tt P K = 0.5K, 
Tps), Based on a PI K = 0.45K, 
Stability Boundary l 
Tı = Ry 
1.2 
K = 0.6K, 
PID T= 
I uw 2 u 
l 
Tp = gh 


gin. The integrator output 4, will grow until the plant output exceeds the command 
input, and this may take a long time. The result is a response shown by the dotted 
line in Fig. 3.14. 

The solution to this problem is to “turn off" the integral action as soon as 
the actuator saturates. (This can be done quite easily if the controller is imple- 
mented digitally.) Two such “antiwindup” schemes are shown in Fig. 3.15(a) and 
(b) using a dead-zone nonlinearity with a PI regulator. In this scheme, as soon as 
the actuator saturates, the feedback loop around the integrator becomes active and 
moves rapidly to keep the input to the integrator e, at zero. During this time the 
integrator essentially becomes a fast first-order lag, as shown in Fig. 3.15(c). The 
slope of the dead-zone nonlinearity K should be chosen to be large enough that 
the antiwindup circuit is capable of following e to keep the output from saturating. 
The effect of the antiwindup Js to reduce both the error overshoot and the control 


FIGURE 3.13 
Feedback system with actuator saturation. 


FIGURE 3.14 

Effect of antiwindup: 
(a) step response; 

(b) control effort. 


3.3 
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y(t) —-—-—-— Without anti-windup 


with anti-windup 


effort in the feedback system. Figure 3.14 shows a step response and control effort 
for a saturating system with and without an antiwindup integrator. 


Steady-State Tracking and System Type 


In the speed control case-study, we considered constant reference inputs and con- 
stant disturbances, and we found that integral control could keep the steady-state 
system error at zero, even with a motor gain that was different from the one used in 
the design. In a number of important cases, the reference input is not constant but 
can be approximated as a linear function of time for a time span long enough for 
the system to reach steady-state and we would like to know what the steady-state 
error is in this case. The generalization is to consider the input to be a polynomial 
in time and to consider the steady-state tracking error that results. As we will see, 
the error is zero for input polynomials up to a certain degree, is a constant for that 
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FIGURE 3.15 
(a) PI controller with antiwindup; (b) alternative PI controller with antiwindup; and (c) first-order lag equivalent of an 


antiwindup integrator during saturation. 


(a) 


(c) 


degree polynomial, and is unbounded for higher degrees. A stable system can be 
classified according to the degree of the polynomial for which the error is constant, 
and the classification is called the system type. 

A typical single-loop feedback block diagram is shown in Fig. 3.16, where 
care has been taken to show the system error, e(t) = r(t) — y(t). The variables 


FIGURE 3.16 
Typical single-loop 
system. 
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are defined as 


r(t) = reference input, 
u(t) — plant input (control signal), 
y(t) = plant output, 
e(t) = system error or r(t) — y(t), 
a(t), b(t) = internal signals; a(t) is called the actuating signal, 
G,(s) = plant transfer function including actuator, 


H(s) = feedback components including sensor transfer function 
and dynamic compensation, 


D(s) = controller transfer function, 


I(s) = input components, that is, reference signal processing 
or prefiltering. 


The feedback transfer function H(s) typically represents the sensor action to 
convert the output y(t) to an electrical sensor output signal b(t). This was K ; in 
the case study. Likewise, we often require a transfer function /(s) to convert the 
reference input, which may be speed or temperature or whatever, into an electrical 
signal to be combined with b(t) in the controller to generate the actuating signal 
a(t). In the case study, we had /(s) = K,. The controller with transfer function 
D(s) converts the electrical actuating signal into the control signal u(t). Notice 
that H and / usually have the same dimensions (volts per 1000 rpm or volts per 
degree Celsius, etc.), and that Z can be assumed to be nonzero. Using this, we can 
simplify Fig. 3.16 to obtain the structure shown in Fig. 3.17. 

Let's assume that the reference input is a polynomial of degree k and com- 
pute the steady-state error for this general system in terms of the given transfer 
functions. If r(t) = (t*/k!)0(r), then the transform of the input is R(s) — 1/s**!, 
If k = 0, the input is a step of unit amplitude; if k = 1, the input is a ramp 
with unit slope; if k = 2, the input is a parabola with unit second derivative; and 
so on. From the common problems of mechanical motion control, these inputs are 
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FIGURE 3.17 

Simplified block diagram 
of a typical single-loop 
system. 


called, respectively, position, velocity, and acceleration inputs. In order to compute 
the steady-state errors, we need the transfer function from input to system error, then 
we can apply the final-value theorem. From the block diagram, the transform from 
r to y is defined as F(s) and is 


IDG, 


FIN S OY 8D6 


(3.18) 


and the system error is 


E(s) = R(s) — Y(s) 
E(s) = R(s) — F(s)R(s). 


The reference-to-error transfer function is 
l= Fs). 
With the test input, the error transform is 
E(s) = x = Fs]. 
S 
We assume that the assumptions of the final-value theorem are satisfied, namely 


that all poles of sE(s) are in the left-half plane. In that case, the steady-state error 
is given by 


€» = lim e(t) = lim sE (s) (3.19) 
t— o sa 

poi, (3.20) 
s—0 S 


By the nature of the limit, we can see that the result of Eq. (3.20) can be zero, can 
be a constant different from zero, or could not exist, in which case the final-value 
theorem does not apply, but it is easy to see that e« = œ in this case anyway 
because E(s) will have a pole at the origin that is of order higher than one. By 
convention, the classification is given that if the solution to Eq. (3.20) is a constarit 
different from zero, the system being considered is type k. 


FIGURE 3.18 
Unity feedback system. 
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Special Case: Unity Feedback 
A further simplification of Fig. 3.17 is possible if H = Z. In that case, which is 
quite common, we can model the system as the unity feedback system as drawn 
in Fig. 3.18 and take advantage of the fact that now the actuating signal is the 
error, a(t) = e(t).* In Fig. 3.18, we have defined G = /DG, as the overall 
feed-forward or open-loop transfer function. 

If our system is described by the block diagram in Fig. 3.18, then 


l 


] - F(s) = 1+ Gos)’ 


and the system error is 


l 


= te Gs eh 


Cx 


If the system is type 0, we set k = 0, and the error is 


l 
[1 + G(0)] 
l 


ta = TENA (3:22) 


Cu = 


The constant defined in Eq. (3.22) is called the position error constant. This 
notation derives from reference to the fact that if the signal being controlled is 
mechanical motion and k = 0, then the reference is a position and the error is a 
position error. The form of the definition leads to the simple computation 


Kp = lim G(s). 


In other words, if the loop is unity feedback and type 0, the position error constant 
is the zero-frequency or DC gain. 
If we now consider ramp inputs, then, from Eq. (3.21) with k = 1, 


. l 
7 BN Gls 
l 
sG(s) 


€ x 


= lim 
s—0 


*Much of the confusion in the literature (textbooks especially) on this topic arises because some authors 
have treated the actuating signal a(t) as if it were the system error even in the general (nonunity 
feedback) case. 
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TABLE 3.3 

Errors versus System 
Type for Unity 
Feedback 


For this error to exist, it is necessary that G(s) have at least one pole at s = 0. 
Suppose it has exactly one; in that case, the system is type 1 (or type I) and the 
error is, by definition 


€» = I/Ky, 


where the error constant is the velocity constant, and with unity feedback, is giv- 
en by 


K, = lim sG(s). 


In similar fashion, systems of type 2 (or type IT) are found to require that in the 
unity feedback case, G(s) must have two poles at s = 0, the error is defined as 


i 
Co = —. 
* E 
The acceleration constant can be computed in the unity-feedback-gain case by 


K, = lim s?G(s). 
s—0 


The situation is summarized in Table 3.3. 
In general, the error constants must be computed from Eq. (3.20), but in the 
special unity feedback gain case, they are given by 


lim s* G(s). 
50 


The definition of system type helps one to identify quickly the ability of a system 
to track polynomials. In the unity feedback structure, the property is "robust" in 
the sense that, if the process gain, such as Ko, changes in a type I system be- 
cause of parameter changes, the velocity error constant changes but the system 
will still have zero steady-state error to a constant input and will still be type I. 


Input 
Step Ramp Parabola 

ppo  ——— œ x 
ii (E) 
Type 1 0 t: oc 
ype K, 

1 
Type 2 0 0 == 


EXAMPLE 3.1 


FIGURE 3.19 

(a) DC motor; 

(b) DC motor with unity 
feedback. 
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This robustness is the major reason for preferring a unity feedback system over any 
other. 

System type can also be defined with respect to disturbance inputs by con- 
sidering system error in response to polynomial disturbance inputs. The reader is 
invited to investigate this property in the problems (see Problem 3.13). 

In many cases, the control system block diagram does not fit the standard forms 
shown in Figs. 3.16, 3.17, or 3.18 and the computation of steady-state errors due 
to the inputs or disturbances cannot be determined easily from Table 3.3. In these 
cases, the designer is advised to derive the Laplace transform of the desired error 
based on the specific input or disturbance to which the error sensitivity is desired 
and to apply the final value theorem to the result. In other words, the steps taken 
in arriving at Eqs. (3.18) through (3.21) should be repeated for the specific block 
diagram being analyzed. 


DC Motor As an example to illustrate the idea of system type, consider the sim- 
plified model of the DC motor employing proportional feedback as shown in Fig. 
3.19(a). Let us use the following parameter values, 


The closed-loop transfer function from r to y (with 7; = 0) is 


l 
— $s-D-K' 


H(s) 


(a) 
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The system error is 


E(s) É Rs) — Y (s) 


Y (s) sis FDTE-I 
= |1- —|= = SS 
c) ay BINE" MR IRE 
The system error due to a unit-step input is given by 
E(s) — E 


Using the Final Value theorem, 


ET lim (6 HG EP ^l 
* s—0 S K 


, 


that is, the feedback system is not capable of following a step with zero steady-state 
error unless K — 1. This is somewhat surprising because the plant itself has a pure 
integrator. This happens because nonunity feedback renders the integrator ineffec- 
tive so far as achieving zero steady-state error to a constant input. Furthermore, 
the error values contained in Table 3.3 no longer apply. However, it is possible to 
remedy this situation by implementing a unity-feedback configuration as shown in 
Fig. 3.19(b). Now we have 


K 
UI PITE 
and 
s(s + 1) 
E(s) = —————— 
(s) s(s + 1)4+K 
Cx = 0, 
hence, 
y(*) = r(@). 
This means that unity feedback provides asymptotic tracking without help from a 
compensator. 


For both setups in Figs. 3.19(a)-(b), the transfer function from the disturbance 
to the output is 


YG) l 
qs)  ss-D-K 


For a unit-step disturbance input, the asymptotic output will be 


EXAMPLE 3.2 
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so that the system is incapable of rejecting the disturbance exactly and there is a 
steady-state offset. The integrator in the plant does not help with this because the 
disturbance enters the system preceding the integrator. 

We may probe a little deeper as to the reason for the tracking properties of the 
system. Note that the transfer functions from r to e in Fig. 3.19(a) (for K = 1) 
and Fig. 3.19(b) (regardless of the value of K) 


E(s) _ s(s + 1) 
Rs)  s(s +1)+ K’ 


both have a zero at the origin. This is called a blocking zero and is the mechanism 
behind the tracking properties. Note that no such blocking zeros exist in the transfer 
function from the disturbance to the output. Hence the system is not capable of 
rejecting the disturbances exactly. 
Let us now investigate the tracking properties of the system with respect to a 
ramp input signal. For the system in Fig. 3.19(a) 
lim 5565 +D+K -1i 
Co = — >, 
s>0 s(s+1)+K s? 
which will be unbounded unless K = 1, that is, there is unity feedback. In that 
case, 


The system in Fig. 3.19(b) will have a constant error due to ramp input which is 
the same as computed above. E 


Satellite Attitude Control The system is as shown in Fig. 3.20(a) with J = 
moment of inertia, 7; — disturbance torque, K — sensor gain, and D(s) is the 
compensator. If the compensator is proportional plus derivative (PD) feedback, 
D(s) = K(1 + Tps), then we may redraw the system as shown in Fig. 3.20(b). 
The system error for a ramp input is 


Js? l 
ba = lim i= :—, 
s>0 Js? + K(1 + Tps) s? 


which is zero. For a parabolic input, where R(s) = 1/5?, there will be a constant 
error 


Note the presence of the two blocking zeros at the origin. The system has a finite 
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FIGURE 3.20 

(a) Satellite attitude 
control; (b) proportional 
plus derivative (PD) 
control; (c) PID control. 


K( 1+Tp s) 


error for a constant disturbance torque, 


l l l 
y(v) = lim s ———_—-- = —. 
s>0 Js2?+K(1+T7ps)s K 


Suppose we use a PID type controller, 


l 
D(s) = K[1 + Tos + 7 i 
Tis 


as shown in Fig. 3.20(c). It may be easily shown that the system now has zero 
error for steps, ramps, and parabolic-inputs. Furthermore, the system now has no 
error to a constant disturbance because, 

{rS l 


^( 00 = li —————————— — 0, 
yin) o Im Fe 4 pst + ae Ds 


3.3 / Steady-State Tracking and System Type 135 


and the integrator from the compensator creates a blocking zero from the distur- 
bance to the output. m 


Truxal’s Formula 

We have derived formulas for the error constants in terms of the system transfer 
function. Truxal (1955) derived a formula for the velocity constant in terms of 
the closed-loop poles and zeros, a formula that connects the steady-state error to 
the dynamic response. Since much of control design requires a trade-off between 
these characteristics, the formula can be very useful and is well worth knowing. 
The derivation is quite direct. Suppose the closed-loop transfer function of a type 
I system is F(s) given by 


(s T ziXs T 22) sss (5 T Zwi) 
(s + pis + p2)...(s + Pa) 


Furthermore, since the steady-state error to a step of a type I system is zero, the 
DC gain is unity, that is, 


F(s) = K (3.23) 


F(0) = 1. (3.24) 
The system error is given by 


E(s)S R(s) — Y(s) 


Y 
= R(s)|1— Zw. R(s)[1 — F(s)]. (3.25) 
R(s) 
The system error due to a unit ramp input is given by 
iF 
E) = tcr (3.26) 
$ 
Using the final-value theorem, 
oy = i DE PA t (3.27) 
50 S 
Using L'Hópital's rule, we may rewrite Eq. (3.27) as 
€» = — lim Ld (3.28) 
T s>0\ ds i 
or 
€» = — lim e 3.29 
* s>0 ds K, ( j ) 


Note that Eq. (3.29) implies that the reciprocal of K, is given by the slope of the 
transfer function at the origin (this fact will be used again in Chapter 5). Using 
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3.4 


Eq. (3.24), we can rewrite Eq.(3.29) as 


€» = — lim il 3.30) 
i s—0 ds F ( l 
or 
bu cdi 3.31 
= s=0 ds ' (9D 


Substituting Eq.(3.23) into Eq.(3.31), 
eem + £i) 


€» = —lim LE 


Pads TIEF p) ida 
= - tim © > nts +2) =D ims + p) (3.33) 
i=l 
or 
l MUN S 
—=>5 — as 3.34 
K, {z Pi “ia Zi ina 


We observe from Eq. (3.34) that the farther the closed-loop poles are from the 
origin, the larger is K,, but that it may also be increased by having closed-loop 
zeros close to the origin. Truxal's formula will be used in Chapter 6 to aid with 
dynamic compensator design. 


Stability 


A system that always gives responses appropriate to the stimulus is considered to 
be stable. In testing the stability of a dynamic system, we must carefully define the 
terms "response," "stimulus," and "appropriate." For example, it is possible for a 
system to have a well-behaved output while an internal variable is growing without 
bound. If we consider only the output as the "response," we might call such a 
system stable; however, if we consider the internal variable to be the response, we 
might just as reasonably call this system unstable. The stimulus might be a signal 
persisting for all time, or it might be only a set of initial conditions. Finally, we 
might require that the response not grow if the stimulus is removed, or we might 
require that the response go to zero if the stimulus is removed. For systems that are 
nonlinear or time-varying, the number of definitions of stability is large, and some 
of the definitions can be quite complicated in order to account for the varieties 
of responses the systems can display. We will describe a few elementary results, 
particularly those results useful in the study of linear constant systems. In addition 


FIGURE 3.21 
Capacitor driven by 
current source. 
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to the results discussed in this section, Nyquist’s frequency-response stability test 
will be presented in Chapter 5, and Lyapunov stability will be covered in Chapter 6. 


3.4.1 Bounded-Input—Bounded-Output Stability 


A system is said to have bounded-input-bounded-output (BIBO) stability if every 
bounded input results in a bounded output (regardless of what goes on inside the 
system). A test for this property is readily found using convolution. If the system 
has input u(t), output y(t), and impulse response A(t), then 


y(t) = | h(r)u(t — Tr)d T. (3.35) 


If u(t) is bounded, there is a constant M such that |u| € M < œ, and the output 
is bounded by 
| hu dt 


| hlola 


< m| Ih(r)|d 7. 


ly] 


lA 


Thus, the output will be bounded if |“, |h|d is bounded. On the other hand, 
suppose the integral is not bounded, and we consider the bounded input u(t — 7) = 
+1 if A(T) > 0, and u(t — 7) = —1 if h(7) < O. In this case, 

y(t) = | Ih(r)|d v, (3.36) 


and the output is not bounded. We conclude that 
The system with impulse response h(t) is BIBO stable if and only if | ^, |h(7)|d < «e. 


Consider, as an example, the capacitor driven by a current source as sketched 
in Fig. 3.21. The capacitor voltage is the output, and the current is the input. One 
would expect that a simple ideal capacitor circuit would be stable. Wrong! The 


u(t) C y(t) 
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impulse response of this setup is h(t) = I(t), the unit step. For this response, 


| Ih(r)|d 7 - | dT (3.37) 
oc 0 


is not bounded. The capacitor is not BIBO stable. Notice that the transfer function 
of the system is 1/s and has a pole on the imaginary axis. Physically, we can 
see that constant input current will cause the voltage to grow, and thus the system 
response is not bounded, and the system is not stable. As a matter of fact, if a 
constant system has any pole on the imaginary axis or in the right-half plane, 
the response will not be BIBO stable; if every pole is inside the left-hand plane, 
the response will be BIBO stable. Thus for these systems, pole locations can be 
used to check for stability. An alternative to computing the integral of the impulse 
response or even to locating the roots of the characteristic equation is given by 
Routh's stability criterion. 


3.4.2 Routh's Stability Criterion 


Consider the characteristic equation of an nth-order system: * 
a(s) = s" + ais"! + ans"? +-+ an-s + dg. (3.38) 


It is possible to make certain statements about the stability of the system without 
actually solving for the roots of the polynomial. This is a classical problem, and 
several methods exist for the solution. One such method was proposed by Routh 
in 1874. An equivalent technique was independently derived by Hurwitz in 1895 
and similar results obtained by Lyapunov in 1893. We will discuss the version 
developed by Routh. Before one considers the full test, one should examine the 
equation to see that it satisfies a simple necessary condition. A necessary condition 
for stability of the system, that is, that all of the roots of Eq. (2.38) have negative 
real parts—is that all the {a;}’s be positive. If any of the coefficients are missing 
(i.e., are zero) or negative, the system will have at least one pole located outside 
the left-half plane (LHP). This condition can be checked by inspection. Once the 
elementary necessary conditions have been satisfied, we need a more powerful test. 
Routh showed that a necessary and sufficient condition for stability is that all of 
the elements in the first column of the so-called Routh array be positive. 

To determine the Routh array, the coefficients of the characteristic polynomial 
are arranged in two rows, each beginning with the first and second coefficients and 
followed by the even-numbered and odd-numbered coefficients as follows: 


s: l a2 a4 
S s 1A aa as 


* The polynomial is assumed to be monic (the coefficient of the highest power of s is 1) without loss 
of generality. 


* This is easy to see if one imagines the polynomial as a product of first- and second-order factors. 
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The following rows are subsequently added to complete the Routh array: 


row n gt 1l 285 
rwn-l s"!: a, as 
rwn-2 s"?: b, b 
rwn-3 s" ?: c c 

rw2  s?^: * * 

row ] So: * 

row 0 P: s 


4 
as 
b3 


C3 


where the elements from the (n — 2)th row on are computed as follows: 


—det a2 
b = dı] a3 e aias = a3 
l "T e^ i 
— det l a4 
Los 1 45) _ a)\a4—~ a5 
3 1^ = j 
—det Mis. 
-— aj; a7 |, 4406— az. 
3 s = ; 
and 
a3 
—det| <! 
b, b» bias "m a b» 
Cj ——————— = ——, 
bi bi 
a; a5 
— det 
b, b3 bias — ajb3 
C Z —————————————————— = —— À— — 
i bi bi 
a | a7 
— det 
bı b4 biaz =. a\b4 
E © — — ——— . 
, bi b, 
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Note that the elements of the (n — 2)th row and of rows thereafter are formed from 
the two previous rows using determinants with the two elements in the first column 
and other elements for successive columns. Normally, there will be n + 1 elements 
in the first column when the array terminates. These must all be positive if all the 
roots of the characteristic polynomial are in the LHP. However, if the elements of 
the first column are not all positive, the number of roots in the RHP equals the 
number of sign changes in the first column. A pattern of +, —, + is counted as 
two sign changes, one going from + to — and the other from — to +. 
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As an example, consider the polynomial 
a(s) = s9 + As? + 3s^ + 2s? + s? +45 +4, 


which satisfies the necessary condition for stability since all the {a;}’s are positive 
and nonzero. The Routh array for this polynomial is 


sí: ] l 4 
s5 : 4 4 0 
4. > | (43) - (WM) — @0)-@d) ,_ @A@—- (1X0) 

S =~ = nian ieee 0 = 1 4 = 
2 4 4 4 

"E (5/20) = (4)0) 12 _ SDA - MA 9 

l 5/2 5 5/2 
2. .. (2)0) - (5/2)(— 12/5) . (2X4) - (5/2)(0) 
s 3 s a. s a eee 

2 2 

7 776 _— = B= 12/5) — (8) 0 

BE: 3 
0 (—76/15)(4) — 0 
TUM US —76/15 


It is seen that the polynomial has RHP roots, since the elements of the first col- 
umn are not all positive. In fact, there are two poles in the RHP since there are 
two sign changes.* Note that in computation of Routh's array, a row may be 
multiplied or divided by a positive constant if this simplifies the rest of the cal- 
culations. Also notice that the last nonzero element in each column of the Routh 
array is simply a, and that the last two rows each have one term. If the first 
term in one of the rows is zero or if an entire row is zero, the standard Routh 
array cannot be formed, and one has to use the special techniques described 
below. 


Special Cases 

If only the first element in one of the rows is zero, we can replace the zero with a 
small positive constant € > 0 and proceed as before. The stability criterion is then 
applied by taking the limit as e — 0. Consider the polynomial 


a(s) — $5 + 35^ + 25? + 65? +65 4- 9, 


* The actual roots of the polynomial are —3.2644, 0.6797 + j0.7488, —0.6046+ j0.9935, and —0.8858, 
which agree with our conclusion. 
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for which the Routh’s array is 


s^: 1 2 6 
4:3 6 9 
new s^: 1 2 3< divide previous row by 3 
$2: 0 3 0 
new $?: e 3 0-« replace zero by € 
pug s 3 0 
E 
3e? 
: — —— 0 
: 25 — 3 
gs 0. 


For small e, there are two sign changes in the first column of the array, which 
implies that there are two poles not in the LHE* An alternative procedure is to 
define the auxiliary variable, 


: (3.39) 
$ 


and convert the characteristic equation so that it is in terms of z. This often produces 
a Routh's array whose elements of the first column are nonzero. The stability 
properties of the system are then deduced from this new array. 

Another special case occurs if an entire row of the Routh array is zero. This 
indicates that there are complex conjugate pairs of roots that are mirror images of 
each other with respect to the imaginary axis. If the ith row is zero, an auxiliary 
equation is formed from the previous (nonzero) row as follows: 


a(s) = Bys't! + Bos! + 355? s, (3.40) 


where (B;)'s are the coefficients of the (i + 1)th row in the array. The ith row 
is then replaced by the coefficients of the derivative of the auxiliary polynomial, 
and the array is completed; however, the roots of the auxiliary polynomial given 
above are also roots of the characteristic equation, and these must be tested sepa- 
rately. 

As an example, consider 


a(s) = s? + 5s* + 11s? + 23s? + 28s + 12, 


* The actual roots are at —2.9043, .6567 1.2881, —.7046 + 7.9929. 
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FIGURE 3.22 
A feedback system for 
stability test. 


for which the Routh’s array is 


5: 1 11 28 


s: 0 0 < a(s) = A^ + 12 
news: 2 0 gs CE ee Be 
ds 


s9: 12. 


Note that the auxiliary polynomial was divided by 3 for simplification. There are 
no sign changes in the first column, hence all the roots have negative real parts 
except for a pair on the imaginary axis. This may be deduced as follows. If the 
zero in the first column is replaced by € > O there are no sign changes. If e < 0 
there would be two sign changes. Thus if € = 0, there would be two poles on the 
imaginary axis. These are the roots of 


a(s) = 5244-20 
or 
pi" 


Routh's method is also useful in determining the range of parameters for which 
a feedback system remains stable. Consider the system shown in Fig. 3.22. The 
stability properties of the system are a function of the feedback gain K. The char- 
acteristic equation for the system is given by 


$41 
— i — 
iD — 1Xs + 6) " 


* The actual roots are at —3, +j2, —1, —1. 


s+1 
s(s—1)(s+6) 
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Or 
s°+5s7+(K —6)s+K =0. 


The corresponding Routh’s array is 


s? l = 
s? 5 K 
4K — 30 
5 
5° K. 


If the system is to remain stable we must have 


4K —30.. 
5 
K 50 
Or 
FE = 75. 
Summary 


In this chapter, some essential properties of feedback have been discussed. Feedback 
can be used to stabilize systems, speed up transient response, improve steady-state 
characteristics, provide disturbance rejection, and decrease sensitivity to parameter 
variations. Some simple types of feedback control have been considered. Propor- 
tional feedback reduces errors, but high gains may destabilize the system. Integral 
control improves the steady-state error and provides robustness with respect to 
parameter variations, but it also reduces stability. Derivative control generally in- 
creases damping and improves stability. The combination of all three, the PID 
controller, is ubiquitous in the process-control industry, and the concepts of in- 
creasing gain to reduce error and adding dynamics to improve response is the basic 
ingredient in virtually all control designs. A set of useful guidelines for tuning PID 
controllers has been presented. We have also discussed the definition of system 
type, which provides a figure of merit indicative of the ability of a system to fol- 
low polynomial time functions with zero steady-state error. Finally, BIBO stability 
and the Routh test for determining stability for linear constant systems have been 
presented. 
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Problems Section 3.1 


3.1 Consider a system with the configuration of Fig. 3.5. Let the gain of the controller be 
D and of the process be G. The nominal values of these gains are D = 5 and G = 7. 
Suppose a constant disturbance, w, is added to the control input before the signal goes 
to the process. The designer is able to increase the loop gain of this system by a factor 
of six before the dynamic response goes cut of specifications. 


a) Compute the gain from w to y. 

b) Where should the designer place the extra gain if the objective is to minimize the 
system error, r — y, due to the disturbance? That is, the gain D can be raised to 30 
or the gain G can be raised to 42, and so on; which is best? 


3.2 Bode defined the sensitivity function of a transfer function G to one of its parameters 
k as the ratio of percent change in k to percent change in G. We define the reciprocal 


FIGURE 3.23 


FIGURE 3.24 


33 


3.4 
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of Bode's function as 


c _ dG/G _ diiG  kdG 


k — dk/k dink G dk’ 


Thus, if the parameter k changes by 1%, S tells us what percent change to expect in 
G. For control systems, we are almost always interested in zero frequency, or s = 0 in 
sensitivity calculations. The purpose of this exercise is to examine the effect of feedback 
on sensitivity. In particular, we would like to compare the topologies shown in Fig. 3.23 
for connecting three amplifier stages of gain —K each into a single amplifier of gain 
710, 


a) For each case, compute f; so that, if K = 10, y = —10r. 

b) For each case, compute $2 when G = y/r. [Use the respective (B;]'s found in 
(a)]. Which case is the /east sensitive? 

c) Compute the sensitivities of Fig. 3.23(b) and (c) to B» and B3. Comment on the 
relative requirements for precision in sensors and actuators from these cases. 


Compare the two structures shown in Fig. 3.24 with respect to sensitivity to changes 
in the overall gain due to changes in the amplifier gain. Use the definition 


as the measure. Select H, and H> so that the nominal values are F; = F^». 


A DC-motor speed control is described by the equation: 


Q + 602 = 600V, — 15007), 


(b) 
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FIGURE 3.25 
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where Q is the motor speed, V, is the armature voltage, and T, is the load torque. Let 


Vı = 
I 


-kla + = | aus 


a) Compute the transfer function from T, to Q as a function of K and Tj. 
b) Compute the values of K and T, so that the characteristic equation of the closed-loop 
system will have roots at —60 + 7/60. 


Section 3.2 


3.5 


3.6 


The unit-step response of a paper machine is shown in Fig. 3.25(a). The time delay 
and the steepest slope may be determined from this transient response. 


a) Find the P-, PI-, and PID-controller parameters using the Zeigler-Nichols transient 
response method. 

b) The system with proportional feedback has the unit-impulse response shown in Fig. 
3.25(b). The gain K, = 8.556 corresponds to the system being on the verge of 
instability. Determine the P-, PI-, and PID-controller parameters according to the 
Zeigler-Nichols ultimate sensitivity method. 


A heat exchanger has the transfer function 


e 5s 


GG) = Tos 4 160s 4 1y' 


a) Find the PID-controller parameters according to the Zeigler-Nichols tuning rules. 

b) The system becomes marginally stable for a proportional gain of K, = 15.25 as 
shown by the unit-impulse response in Fig. 3.26. Find the optimal PID-controller 
parameters according to the Zeigler-Nichols tuning rules. 
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FIGURE 3.27 - 

Single input-single ouput 
unity feedback system 
with disturbance units. 


Section 3.3 


3.7 


3.8 


3.9 


A certain control system has the following specifications: rise time t, = 0.010s and 
percent overshoot M, = 17; and steady-state error to unit ramp e ss = 0.005. 


a) Sketch the allowable region in the s plane for the dominant second-order poles of 
an acceptable system. 

b) If y/r for this system is G/(1 + G), what is the behavior of G(s) near s = O for 
an acceptable system? 


a) Compute the steady-state error to a unit-step, reference input for the system of 
Problem 3.4(b). 

b) Compute the steady-state error to a unit-ramp, reference input for the system of 
Problem 3.4(b). 

c) Compute the steady-state error to a unit-step, disturbance input for the system of 
Problem 3.4(b). 

d) Compute the steady-state error to a unit-ramp, disturbance input for the system of 
Problem 3.4(b). 


System type for disturbance inputs: In most control systems, disturbances of one type 
or another exist. In practice, these disturbances are represented by polynomial time 
functions such as steps or ramps. This would suggest definitions of system type with 
respect to disturbance rejection analogous to those suggested in this chapter for tracking. 
Consider the unity feedback system shown in Fig. 3.27 with disturbance inputs W,, W2, 
and W3. The closed-loop system is asymptotically stable and 


Kı s zu) 
shi TTE + pu) 
K;|l7i,G + za) 
sh | [731 + pai) 


Gi(s) = 


G(s) = 


a) Show that the system is of type 0, type lı, and type (lı + l2) with respect to 
disturbance inputs Wi, W2, and W3, respectively. 

b) Consider the multivariable system shown in Fig. 3.28. Find y, and y; for con- 
stant disturbances. What is the system type with respect to disturbances at W;? 
At W2? 


FIGURE 3.28 
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FIGURE 3.29 


3.10 One possible representation of an automobile speed-control system, with integral con- 


3.11 


trol, is shown in Fig. 3.29. 


a) With zero command input (v. = 0), find the transfer function relating the output 
v to the wind disturbance w. 

b) What is the steady-state response of v if w is a unit ramp function? 

c) What type is this system in relation to command inputs? What is the value of the 
static error constants K, and K,? 

d) What type is this system in relation to disturbance w? What is the error constant 
due to the disturbance? 


For the feedback system shown in Fig. 3.30, find o to make the system type I for 
K = 5. Show that the system is not robust by using this value of œ and computing 
the tracking error e — r — y to a step command for K — 4 and K — 6. 
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FIGURE 3.30 


FIGURE 3.31 


3.12 


3.13 


A position-control system has the overall transfer function (meter/meter) given by 


» bos + bi 
r. Sb. 


Suppose we are able to select all the parameters. Choose them so that 


a) Rise time is f£, = 0.1 s. 

b) Percent overshoot M, = 20. 

€) Setting time f, = 0.5 s. 

d) Steady-state error to a constant command is zero. 

e) Steady-state to a ramp of 0.1 m/s is not more than | mm. 


Two feedback systems are shown in Fig. 3.31. 


a) Determine values of K,, K2, and K3 so that both systems exhibit zero steady-state 
error to step inputs (i.e., Type I) and such that K, = 1 in both cases if Ko = 1.0. 

b) Suppose Ko changes to Ko = Ko + 6Ko (where 6K, is a small change in the 
nominal value of gain Ko). Prove that (a) is still a Type I system in spite of the 
perturbation in Ko. 

€) If Ko = Ko + 6Ko, show that the system in Fig. 3.31(b) is no longer Type I. 

d) Explain why control engineers prefer the system in Fig. 3.31(a) over that in Fig. 
3.3105). 


(a) 


(b) 


FIGURE 3.32 


FIGURE 3.33 
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3.15 


3.16 
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1 
(stp1)(s+pg). . (St pg) 


e) Estimate the transient response of both systems to a step reference input and 
compute ¢,,¢,, and M,. In your opinion, which system has a better tran- 
sient response at the nominal parameter values? Consider rise time and over- 
shoot. 


Consider the system shown in Fig. 3.32. 


a) Find the transfer function from the input to the tracking error. 

b) It is desired that this system respond to inputs of the form r(t) = t"(n < q) with 
zero steady-state error. If this requirement is to be met, what must be true about 
the open-loop poles pi, P2, .... Pq? 


The feedback control system shown in Fig. 3.33 is to be designed to satisfy the 
following specifications: (1) steady-state error to a ramp input less than 10% of the 
input magnitude,(2) maximum percent overshoot for a unit step input less than 5%, 
and (3) settling time (1%) less than 3 s. 


a) Compute the closed-loop transfer function. 

b) Find the error due to a unit ramp input. 

c) What does (1) imply about the possible values of K ;? 

d) What does (3) imply about the closed-loop poles? 

e) Sketch the region in the complex plane where the closed-loop poles may lie. 

f) Suppose K, = 32. Find the values of K» such that the poles are on the right-hand 
boundary of the feasible region. 

g) Estimate the settling time of the system. 


The transfer functions of a magnetic-tape-drive speed-control system are shown in Fig. 
3.34. The speed sensor is fast enough that its dynamics can be neglected. 


a) What is the steady-state error due to a step disturbance torque of 1 N-m? (Here 
assume w, = 0.) What must the amplifier gain K be in order to make the steady- 
state error e,, = 0.01 rad/s? 
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FIGURE 3.34 


3.17 


Amplifier 


Disturbance 


torque Tape 


Torque motor dynamics 


b) Plot in the complex plane the roots of the closed-loop system, and accurately sketch 
the time response w(t) for a step input w, for the gain K in (a). Are these roots 
desirable? Why or why not? 

c) Plot the region in the complex plane corresponding to the specifications 


t, = settling time = 0.1s, 


M, = percent overshoot = 5. 
d) Suggest a simple control scheme that can be added to the proportional control 
system above to meet the specifications in (c), and show that the new scheme does 
meet the specifications. 


e) How would the disturbance-induced steady-state error change with the new control 
scheme in (d)? How could the steady-state error be eliminated entirely? 


A linear ordinary differential equation model of the DC motor with negligible armature 
inductance (L, = 0) and disturbance torque Q; is given by 


IR - à R; 
— j--K,0 = Vo + — Qi. 
Kn K, 9 


Dividing by the coefficient of 0, we obtain 
6 + að = bo V, > CoQ, 


where 


p 


With rotating potentiometers, it is possible to measure the positioning error between 6 
and the reference angle 0,. Call this error e = 0,—0. With a tachometer, we can measure 
motor speed 0. We would like to consider feedback of error e and output velocity @ in 
the form 


V, = K(e = 78). 
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a) Draw a block diagram of the resulting feedback system. 

b) Suppose the numbers work out so that a; = 65, bọ = 200, and co = 10. If there 
is no load torque (Q; = 0), what speed (rpm) results from V, = 100V? (In the 
equations above, 0 is measured in radians.) 

c) Using the parameter values given in (b), find K and Tp so that a step change in 6, 
with zero load torque results in a transient, having approximately 17% overshoot, 
that settles to no more than 5% of steady-state in 0.05 s. 

d) Compute an expression for the steady-state error to an arbitrary reference angle, 
and give its value for 0, — 1 rad for your design from (c). 

e) Compute an expression for the steady-state error to a disturbance torque when 
0, = 0 and give its value for Q; = 1.0 for your design from (c). 


We wish to design an automatic speed control for an automobile. Assume the pertinent 
characteristics are (1) the car has mass m of 1000 kg, (2) the accelerator is the control 
U and supplies a force on the automobile of 10 N per degree of accelerator motion, 
and (3) air drag provides a friction force (proportional to velocity) of 10 N :s?/m. 


a) Obtain the transfer function from U to velocity of the automobile. 
b) Regardless of the answer you get for (a), assume the velocity changes are given by 


l 0.05 
E gp =- PIE HCl esM 
WS) Ios t irgog ^ 


where V is in m/s and G is the grade in %. Design a proportional control law that 
will maintain a velocity error of less than 1 m/s in the presence of a constant 2% 
grade. 

c) Discuss what advantage (if any) integral control would have on this problem. 


d) Assuming pure integral control (i.e., no proportional term) is advantageous, select 
the feedback gain so that the roots have critical damping (¢ = 1). 


Section 3.4 


3.19 


3.20 


Use the Routh criterion to determine if the closed-loop systems under unity feedback 
corresponding to the following open-loop transfer functions are stable. 


= 4(s + 2) 
Se s(s? +2 +35 +4) 
b) KG(s) = B 

s^(s + 1) 
3 2 
ö KG(s) = 4(s* -2s^ +5 +1) 


s?’ (s? +2s7-—s-1) 


Use Routh’s stability criterion to determine how many roots with positive real parts 
each of the following equations has. 


a) s* + 8s? + 325? + 80s + 100 = 0. 


b) s? + 10s* + 30s? + 80s? + 344s + 480 = O. 
c) st +2s? +7s?—2s +8 = 0. 
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FIGURE 3.35 


3.21 


3.22 


3.23 


d) s? 5? -20s +78 = 0. 
e) st + 6s? +25 = Q. 


For what range of K would all the roots of the following polynomial be in the left-half 
plane? 


s°+5s*+ 10s? + 10s? + 5s +K =0. 
A typical transfer function for a tape-drive system would be (with time in milliseconds) 


K(s + 4) 


OW) — T4054 Dott 04s 1 4I 


From Routh's criterion, what is the range of K for which this system is stable if the 
characteristic equation is 1 + G(s) = 0? 


Automatic ship steering is particularly useful in heavy seas when it is important to 
maintain the ship along an accurate path. Such a control system for a large tanker is 
shown in Fig. 3.35, with the plant transfer function relating heading changes to rudder 
deflection. 


a) Write the differential equation that relates the heading angle to rudder angle for 
the ship without feedback. 

b) Is the control system stable as shown (simple proportional control with a gain of 
1)? Hint: Use Routh's criterion. 

€) Is it possible to stabilize the system by changing the proportional gain from 1 to 
some lower value? 


d) Suggest another possible control scheme that might improve matters. Investigate 
its stability. 


Heading v 


—0.164(s--0.2)(s—0.32) 
s?(s--0.25)(s— 0.009) 


4.1 


The Root-Locus 
Design 


Method 


Introduction 


In Chapter 2, we discussed models of dynamic systems and the relationships be- 
tween the time-domain response and the transform-domain parameters of poles and 
zeros. We related the features of a step response such as rise time, overshoot, and 
settling time to pole locations in the s plane characterized by natural frequency 
wn, damping ¢, and real part ec. We also examined the changes in these transient- 
response features when a pole or a zero is added to a given simple transfer function. 
In Chapter 3, we saw how feedback can influence stability and dynamic response 
by changing the system's pole locations. In this chapter, we present a specific tech- 
nique developed to help in the design of feedback systems, a technique based on 
studying the effects of a single parameter on closed-loop pole locations. While the 
method is a general one, permitting the effects of any one parameter to be studied, 
the most common case involves study of open-loop gain, and the method will be 
presented and first used in this context. The reader should keep in mind that any 
single real parameter can be used; extensions of the method based on this fact are 
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FIGURE 4.1 

Basic closed-loop block 
diagram used to develop 
the root-locus method. 


described in Section 4.6. The method was developed by W. R. Evans (1948) and 
is called the root-locus method. 

We begin with the basic feedback loop shown in Fig. 4.1. For this system, 
the transfer function is 


Y(s |  KaKpG(s) 


R(ó) 1-4 K4KpG(s)’ Uh) 


and the characteristic equation, whose roots are the poles of this transfer func- 
tion, is 


1+ KAKpG(s) = 0. (4.2) 


Clearly, the closed-loop poles depend on the amplifier gain K4, and we will have 
some influence over the closed-loop dynamic response through our choice of K 4. 
Evans suggested that the control-system designer construct the locus of all possible 
roots of Eq. (4.2) as K4 varies from zero to infinity; a study of the resulting plot then 
aids in the selection of the best value of K4. Furthermore, by studying the effects of 
additional poles and zeros on a given locus, we can examine the consequences of 
additional dynamics in the loop; we thus have a tool not only for gain selection but 
for dynamic-compensation design as well. Similarly, we can examine the effect of 
plant-parameter changes to aid in achieving best overall control design. The graph 
of all possible roots of Eq. (4.2) versus some parameter is called the root-locus, 
and the design technique based on it is called the root-locus method of Evans. We 
begin with the mechanics of construction of a root locus, using amplifier gain as 
the parameter. 

To set the notation for our study, we assume here that KpG(s), the process 
transfer function, is a rational function with numerator Kpb(s), where b(s) is a 
monic* polynomial of degree m, and the denominator polynomial is a(s) of degree 


* Monic means the coefficient of the highest power of s is 1. 


Controller Plant 
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n, where n = m, and 


b(s) = s" + bus" ! +---+ dy 


= (s — z1)(s — Z2) °°" (5 — zm) (4.3a) 
= | lis -N (4.3b) 
a(s) = ee ays” | +++ + ap (4.3c) 
= [Je - p». (4.3d) 


i=l 


For our initial study, we assume that Kp is positive and take the product of 
K4 and Kp to be the root-locus parameter K so that 


K = KaKp. (4.4) 


The roots of b(s) = 0 are labeled z;, and they are the zeros of G(s); the roots of 
a(s) = 0 are labeled p;, and they are the poles of G(s). The root locus problem 
expressed in Eq. (4.2) may now be stated in several equivalent but useful ways. 
Each of the following equations has the same roots: 


1+ KG(s) = 0, (4.5a) 

1+ y 6) = 0, (4.5b) 
a(s) 

a(s) + Kb(s) = 0, (4.5c) 

G(s) = -Y (4.5d) 


The root locus is the locus of values of s for which Eq. (4.5) holds for some 
positive real value of K (and K 4). 

Before looking further into the general problem, let's solve a specific case by 
direct calculation. Suppose we have normalized the transfer function of the DC 
motor position control so that 


ier s(s +1) 


In terms of the notation introduced thus far, we have m = 0, n = 2, and 


Kp = 1, 
b(s) = 1, 
a(s) — s $; 


Pi = I T. 
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FIGURE 4.2 

Root locus for G(s) = 
l/[s(s + 1)] as a function 
of open-loop gain K. 


From Eq. (4.5c), the root locus is a graph of the roots of the quadratic equation 
s? +s+K=0. (4.6) 


By formula, we can immediately express the roots of Eq. (4.6) as 


l J/1—4K 


+ 


2 5 (4.7) 


ri, f2? = — 
A plot of the corresponding root locus is shown in Fig. 4.2. ForO = K < 1/4, the 
roots are real between — 1 and 0. At K = 1/4, there are two roots at — 1/2, and for 
K > 1/4 the roots become complex, with a real part —1/2 and an imaginary part 
that increases essentially in proportion to the square root of K. The dashed lines 
in Fig. 4.2 correspond to roots with damping ratio ¢ = 0.5. The poles of G(s) at 
s = 0 and s = —1 are marked X , and the points where the locus crosses the 0.5 
damping-ratio lines are marked with a dot (*). These points correspond to where 
the roots of Eq. (4.6) will be for the specific value of K = 1. We can compute K 
in this instance because we know that, if  — 0.5, the magnitude of the imaginary 
part of the root is y3 times the magnitude of the real part. Since the size of the 
real part is 1/2, then from Eq. (4.7), 


JAK —-1 3 


2 A? 


which is true if K = 1. 
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We can observe several features of this simple locus by looking at Eqs. (4.6) 
and (4.7) and at Fig. 4.2. First, there are two roots and thus two branches to the 
root locus. At K = 0, these branches begin at the poles of G(s) (which are at 
0 and —1) as they should, since for K = O the system is open loop. As K is 
increased, the roots move toward each other, coming together at s = —1/2. At 
that point, they break away from the real axis. After the breakaway point, the roots 
move off to infinity with equal real parts, so the sum of the two roots is always — 1. 
From the viewpoint of design, we see that, by choice of gain K, we can cause the 
closed-loop poles to be at any point along the cross that makes up the root locus 
in Fig. 4.2. If some points along this locus correspond to satisfactory transient 
response, we can complete the design by choice of the corresponding value of K; 
otherwise we will be forced to consider more complex compensation. 

As we pointed out earlier, the root-locus technique is not limited to finding root 
loci versus the system gain (K in the preceding example). All the same ideas are 
applicable for finding loci versus any parameter in a system characteristic equation. 
For example, let’s examine the same G(s) as before, but with K fixed (= 1) and 
with the motor time constant as the parameter of interest. That is, we select the 
open-loop transfer function 


G(s) = e-bay (4.8) 
The corresponding closed-loop characteristic equation is 
1+ G(s) =0 
or 
s*+es+1=0. (4.9) 


The same forms of Eq. (4.5), with the associated definitions of poles and zeros, 
will apply if we assign 


a(s) = s* +1, 
b(s) = s, 
K ^ c. 


The solutions to Eq. (4.9) are easily computed as 


Go owgt vd 

Fita eo E oem, (4.10) 

2 2 

and the locus of solutions versus the parameter c is shown in Fig. 4.3, with the 

poles again indicated by X ’s and the zero by O. Note that when c = 0, the roots 

are at the X 's and are oscillatory, while the damping ratio Z grows as c grows. 
Of course, computing the root locus for a quadratic equation is easy to do since 


we can solve the characteristic equation Eq. (4.6 or 4.9) for the roots, as is done 
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FIGURE 4.3 

Root locus vs. damp- 
ing factor c for the plant 
G(s) = I/[(s)\(s + c)]. 


4.2 


Im(s) 


—4 x Re(s) 


in Eq. (4.7) and (4.10), and directly plot these as a function of the parameter K or 
c. To be useful, the method must be suitable for much higher-order systems, where 
explicit solutions are impossible. General properties of the root locus and rules for 
the construction of complex graphs of roots were developed by Evans, and together 
they constitute the mechanics of drawing a root locus, the core of the method. The 
general method will be presented in guidelines that can be followed in a step-by- 
step manner to sketch any root locus. The techniques will be developed assuming 
the loop gain K as the parameter of interest. In Section 4.6, the modifications for 
other parameters will be developed. 


Guidelines for Sketching a Root Locus 


Our goal in this section is to study the equations defined by Eq. (4.5) and to extract 
as much information as possible from them to aid us in sketching a reasonably ac- 
curate picture of the root locus for the given G(s). It is important to keep in mind 
the reasons for making the plot as the guidelines are presented. The purpose of the 
root locus is to show in a graphical form the general trend of the roots of the closed- 
loop system as the parameter is varied. There are two reasons for learning how to 
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generate a root locus by hand—first, so that we can use the manual method for 
design of fairly simple systems, and second, so that we can verify and understand 
computer-generated loci. The latter reason will become increasingly important as 
the cost of computers continues to decrease and control-design software becomes 
more available. 

In this case, we are interested more in the general shape of the locus than 
in specific values, and some of the following rules may be omitted. Important 
features from a computer-generated locus can be judged to be correct or not by 
a good understanding of how loci must behave. For a manual control design to 
be feasible, we need to be able to sketch a locus quickly so that several attempts 
at the trial-and-error process are possible. Reasonable accuracy is possible with 
experience, and good estimates can be made as to how an additional pole or zero 
will change a locus and permit a better system design. 

As a starting point for our guidelines, we begin with an alternative definition 
of the root locus. Earlier, we defined it this way: 


Definition I: The root locus is the locus of values of s for which 1 + KG(s) = 0 
is satisfied as the real parameter K varies from zero to infinity. Usually 1 + KG(s) 
is the denominator of a transfer function of interest, so roots on the locus are closed- 
loop poles of the system. 


Let’s look at Eq. (4.5d). If K is to be real and positive,* G(s) must be real and 
negative. In other words, if we arrange G(s) in polar form as magnitude and phase, 
the phase of G(s) must be the opposite of that of K to complete the requirement 
that Eq. (4.5) be satisfied. We can thus define the root locus as follows. 


Definition II: The root locus of G(s) is the locus of points in the s plane, where the 
phase of G(s) is 180°." 


Since phase is unchanged if an integral multiple of 360° is added, we can 
express definition II as ZG = 180° + 1360°, where l is any integer. The im- 
mense merit of definition II is that, while it is very difficult to solve a high-order 
polynomial, computation of phase is relatively easy. From definition II we can, in 
principle, sketch a root locus for a complex transfer function by measuring phase 
and marking down those places where we find 180°. This direct approach can be 
illustrated by considering the example 


s+1 


AS) 7 IRE + dIG SP 


(4.11) 


*This is the usual case, but K could be real and negative, in which case G(s) would be real and 
positive. 


t The phase of G(s) is 0? if K is negative. See Section 4.6. 
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FIGURE 4.4 

Measuring the phase of 
G(s) = (s + 1){s[(s + 
2)? + 4](s + 5)). 


In Fig. 4.4, the poles of this G(s) are marked x and the zeros are marked O. 
Suppose we select the test point sọ = —1 + j2. The vector so + 1 is found by 
drawing a line from the zero location —1 to the test point so. In this case, the 
line is vertical and has a phase angle, marked y on Fig. 4.4. In similar fashion, 
the vector sg is shown with angle ¢;, and the angles of the two vectors from 
the complex poles at —2 + j2 to so are shown with angies $» and #3. The 
phase of the vector (sg + 5) is shown with angle $4. The total phase of G(s) at 
$ = So is found as the sum of the phases of the zero terms minus the phases of 
the denominator terms corresponding to the poles: 


LG = Wh — di =$ — 3 — 04 
90° — 116.6° — 0° — 76° — 26.6° 
= —129.2°. 


Since the phase of G is not 180°, we conclude that so is not on the root locus, and 
we must select another point and try again. Clearly, although measuring phase is 
easy, measuring phase at every point in the s plane is hardly the practical guide to 
the sketch we need. We must back off a bit more and seek general guidelines as 
to where the root locus is. For simpler reference later, we will present the results 
as a list of steps that, if followed, will go far toward indicating where a root locus 
is. To illustrate the guidelines, we will use first the transfer function 


l 
s[(s + 4)? + 16] 


G(s) — 


(4.12) 
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STEP 1: Draw the axes to the s plane to a suitable scale and enter an X on this 
plane for each pole and a O for each zero. See Fig. 4.5(a). 


STEP 2: Find the real axis portions of the loci. If we take a test point on the real 
axis, such as so in Fig. 4.5(b), we find that the angles of the two factors in a(s) 
due to the complex poles are @; and @2 such that 6; = —», and they cancel each 
other. The same would be true, of course, for the angles from complex zeros. The 


FIGURE 4.5 
Step-by-step development of a root locus. 


Step 1: Mark the poles and zeros. 
(a) (b) 


Im(s) 


Re(s) 


—4 


Step 3: Draw the asymptotes. Step 4: Compute the departure and arrival angles. 
(c) (d) 
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result is that the angle of G(so) for so on the real axis is given by the angles from 
poles and zeros on the real axis. But these angles are 0° if the test point is to the 
right and 180° if the test point is to the left of the pole or zero. For the angle to 
add to 180° + 1360°, the test point must be to the left of an odd number of real 
axis poles plus zeros. In our test case, there is one real axis pole at the origin so 
the locus is on the real axis for all so to the left of the origin. Accordingly, we 
mark this segment with a heavy line in Fig. 4.5(b). 


STEP 3: Draw the asymptotes for large K. As K goes to infinity, the equation 
1+KG(s) = Ocan be satisfied only if G(s) = 0. This can occur in two apparently 
different ways. In the first instance, since G = b(s)/a(s) we have G = 0 if 
b(s) = 0. Therefore, for large K, a root of 1 + KG = O0 will be found near the 
zeros of G, which is where b(s) = 0. To see the second manner in which G(s) 
may go to zero, let's repeat Eq. (4.55): 


1 + g 5» = 0. (4.5b) 
a(s) 


Using Eq. (4.3), this may be written as 


m Lp m-l.... +b, 
pag. 0 9 7 D (4.13) 
B" ag att ole Fog 


We are interested in the case of large K. If n > m,* then it is clear that G(s) 
goes to zero as s goes to infinity. In fact, for very large s, the poles and zeros 
would appear to be in a cluster, m zeros would essentially cancel the effects of m 
on the poles, and the rest (n — m poles) would appear to be at the same place. We 
conclude that our equation may be approximated by 


l 
TS Pa. (4.14) 
(s — a)” m 


for large s and K.' We say that the locus of Eq. (4.13) is asymptotic to the locus 
of Eq. (4.14) for large K and s. We need to compute a and to find the locus for 
the asymptotic system. To find the locus, we let our search point so be such that 
so = Re/® for some large fixed R and variable $. Since all poles of this simple 
system are in the same place, the angle of its transfer function is 180? if all n — m 
angles, each equal to ¢;, add to 180°. œ; is given by 


(n — m)ó, = 180? + 1360? 


* This must be the case if G(s) represents a physical system and K is the open-loop gain. 


* You can also obtain this approximation by dividing a(s) by b(s) and matching the dominant two terms 
(highest powers in s) to the expansion (s — a)". 
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for some integer / and for any R. Thus, the asymptotic root locus consists of radial 
lines at the n — m distinct angles given by 


pare” FEILLZ. 9-7-9-L (4.15) 
n—m 
For our example system, n — m = 3 and $153 = 60°, 180°, and 300°. The 
lines of the asymptotic locus come from so = a on the real axis. To determine 
a, we make use of a simple property of polynomials. Suppose we have a monic 
polynomial with coefficients a; and roots p;, as in Eq. (4.3c and d), and we equate 
the polynomial form with the factored form 


s" + ays" | aos" ? ra, = (s — pis — pi) C: Xs — Pn). 


If we multiply out the factors on the right-hand side of this equation, it is easy to 
see that the coefficient of s" ! is —p, — p2 — ::: — pn. From the left side, we 
see that this term is aj. Thus, a; = — >_p;; in other words, the coefficient of 
the second-highest term in a monic polynomial is the negative sum of its roots — in 
this case, the poles of G(s). Applying this result to the polynomial b(s), we find 
the negative sum of the zeros to be bı. These results can be written as 


-b = > zi, 
-a = > pi. (4.16) 


Finally, we apply this result to the closed-loop characteristic polynomial obtained 
from Eq. (4.13): 


s" t+ ais" | o + an + K(s" + bis"! + +++ + bm) = 0. 


Here the sum of the roots is the negative of the coefficient of s$"-l. which is aj, 
independent of K if m < n — 1. But since this is the closed-loop characteristic 
equation, this coefficient is the negative of the sum of the roots of the closed-loop 
system, > ri. We have thus shown that the center point of the roots does not 
change with K if m — n — 1, and the common open-loop and closed-loop sum is 
—à,, Which can be expressed as 


-> necp. (4.17) 


For large K, m of the roots r; coincide with the z; and n — m are from the 
asymptotic l/(s — a)" " system whose poles add up to (n — m)a. Combining 
these results, we have that the sum of all the roots equals the sum of those that 
go to infinity plus the sum of those that go to the zeros of G(s). We have shown 
that 


+> ri = +(n —m)a+ > zi = +> pi. 
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From this we solve for o as 


ai an 2 pi-2.0b 


n-—m 


(4.18) 


Notice that the imaginary parts always add to zero, so Eq. (4.18) gives new infor- 
mation about the real parts only. For our example system, 


|^ -4-4+40 
3-0 
8 
--l--28. 
: 67 


These asymptotes are sketched in Fig. 4.5(c). Notice that the asymptotes cross the 
imaginary axis at + j(1.67) Ja = tj4.62. 


STEP 4: Compute the departure and arrival angles. At this point we know that the 
loci begin at the points marked x —the poles of G(s)—and that they go either to 
the points marked © —the zeros of G(s)—or they go to infinity approaching the 
radial asymptote lines. We next compute the angle by which a branch of the locus 
departs from one of the poles. For this purpose, we take a test point very near pole 
2 at —4 + j4 and compute the angle of G(so). The situation is sketched in Fig. 
4.5(d). We select the test point to be so close to the pole that the other angles (¢, 
and @3 in this case) do not change significantly as the test point moves around. 
We have the situation where all angles but one are fixed, and that one takes on 
whatever value will be necessary to meet the root-locus angle condition. For our 
illustrative example, the situation is as shown in Fig. 4.5(d), and the values are 


od; = 90° and ds = 135°. 
Thus, the angle condition is 
—90° — œ — 135° = +180° + 1360°, (4.19) 


where the integer / is selected so that the result for @2 is between +180°. For a 
single angle, / will take on one value. For a multiple pole or zero of order n, / takes 
on n distinct values corresponding to the n branches of the root locus. Continuing 


with the example, we take / = —1 and find that 
=q = 90? + 135? + 180? — 360°, 
h — —45°, 
If we had let / = 0, we would compute $; = —405°, which is the same as —45°. 


By the complex conjugate symmetry of the plots, the angle of departure of the 
locus near pole 1 at —4 — j4 will be +45°. We, of course, found that pole 3, at 
the origin on the real axis, departs at 180° along the real axis in step 2. 

The nature of the calculation of a departure angle for small K, as shown in 
Fig. 4.5(d), is also valid to compute the angle by which a root locus “arrives” at 
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a zero of G(s) for large K. These angles should also be computed at this step and 
the process will be illustrated in our next example. 


STEP 5: Estimate (or compute) the points where loci cross the s = jw axis.* A 
root of the characteristic equation in the right-half plane implies that the closed- 
loop system is unstable, a fact that can be tested by Routh’s criterion (Chapter 
3). If we compute the Routh array with K as a parameter, we can locate those 
values of K such that an incremental change will cause the number of roots in the 
right-half plane to change. Such values must correspond to a root locus crossing 
the imaginary axis. Given the facts that K is known and that a root exists for 
$0 = jWo, it is often not hard to solve for the frequency wo. 
For the third-order example being used, the characteristic equation is 


K 


i+ si FAY E16) 0, 
which is equivalent to 5^: [ss ril 
s? + 8s? + 32s +K = 0. (4.20) 
The Routh array for this polynomial is 
l 32 
8 K 
oe =E 0 
K. 


In this case, we see that the equation has no roots in the right-half plane for 
0 < K < (8)(32) = 256. Since we are interested in the locus for positive K, the 
upper bound is the point of interest here. For K < 256, there are no roots in the 
right-half plane, and if K > 256, the Routh test indicates that there are two roots 
in the right-half plane. Thus K = 256 must correspond to a solution at s = jwo 
for some wọ. If we substitute this data into Eq. (4.20), we find 


(joo) + 8(jwo)” + 32 (jo) + 256 = 0. (4.21) 


If Eq. (4.21) is to be true, both real and imaginary parts must equal zero." This 
gives us the equations 


—8o$ + 256 = 0, 
—we + 32a = 0. (4.22) 


*For systems of order above 4, this step can be tedious and is often omitted in manual plotting. 
Computer-generated loci, of course, easily calculate the points of crossing. 


t Did you notice that we could have substituted an unknown K in Eq. (4.21) and computed that 
K = 256 without using the Routh array in this case? 
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The solutions to Eq. (4.22) are wọ = + J32 = +5.66. We note that the asymp- 
totic locus crosses the imaginary axis at s = j4.62, which is below the actual 
locus crossing. 


STEP 6: Estimate locations of multiple roots, especially on the real axis, and deter- 
mine the arrival and departure angles at these locations.* As with any polynomial, 
it is possible for a characteristic polynomial of degree greater than 1 to have multi- 
ple roots. In the second-order locus we plotted in Fig. 4.2, there were two roots at 
s = —1/2 when K = 1/4. At this point, we found that the loci come together and 
break away from the real axis, becoming complex for K > 1/4. The loci arrive at 
0? and 180° and depart at +90° and —90°. For simple systems, it is possible to 
use a formula for points of multiple roots, but the formula is only slightly easier to 
solve than the original root locus, so the best approach is to estimate these points 
based on a study of several prototype cases to be given soon. However, we will first 
demonstrate the formula that is useful for simple cases and which, if a means of 
solving higher-degree polynomials is available, can be used in complicated cases. 

If we look again at the second-order root locus of Fig. 4.2 and consider what 
happens to the gain K between — 1 and 0 along the real axis, we realize that K = 0 
at s = —1, K increases steadily to K = 1/4 at s = —1/2, and, staying on the 
real axis, K decreases back to zero at s = 0. The gain has a maximum at the 
point of multiple roots, s = —1/2. Since G(s) is a smooth function except at a 
pole and from the characteristic equation K = —1/G, the change in K must be 
smooth. Therefore, if K is to have a maximum at this point, the derivative of K 
with respect to s must be zero at the locus “breakaway,” or multiple-root, point. 


Using the relation K = —1/G, we thus obtain the formula 
d 1 
—|-— = 0. 4.23 
ds | G | = S0 i } 


Since G = b/a, Eq. (4.23) requires that 
| d 
d E 1 | da : E 


p? 


* Like step 5, this step is also not often done by hand. 
"Notice that dG/ds = 0 and d/ds InG = 0 as well. This latter form gives 


[n £24) + nor — 25) ***— lols = py) — ***— ns = BJ] 


l l ] l 
= + +e scm 09.8 um = dy 
$0 — Z1 $0 — Z2 S0 — PI S — Dn 


Evans used this form to estimate sg on the real axis. One can also derive Eq. (4.23) from the observation 
that, at a point of multiple roots, the root-locus equation has the form 


a(s) + Kb(s) = (s — rif (sr). 
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For the second-order case, we have 


db 
b = 1, T7 0; 
a =s +s, La EE PN 
ds 
Substituting into Eq. (4.24), we find 
259-120 
l 
So = 75 (4.25) 


which confirms our previous observation of the breakaway point. For the third-order 
case given by the plots in Fig. 4.5, the polynomials are 


db 
= |, — = 0; 
á ds 
3 2 da 2 
a = s” + 8s“ + 32s, "ue cM + 16s + 32. 
S 


The points of possible multiple roots are at 


3s? + 16s +32 = 0 
so = —2.67 + j1.89. (4.26) 


However, our plot of Fig. 4.5(e) shows that these points are not on the root locus 
and are extraneous. This emphasizes that Eq. (4.24) is derived if so is a multiple 
root on the locus. The derivative condition is necessary but not sufficient to indicate 
a breakaway, or multiple-root, situation. 

In order to compute (estimate) the angles of arrival and departure from a point 
of multiple roots, it is useful to introduce two additional features of the root lo- 
cus. The first concept we need is that of the continuation locus. One can imagine 
plotting a root locus for an initial range of K, perhaps for 0 = K = Ko. Then, 
if we let K = Ko + Kj, a new locus can be plotted with parameter Kı, a locus 
whose starting poles are the roots of the original system at K = Ko. To see how 
this goes, we return to the second-order root locus of Eq. (4.6) and let Ko be the 


Clearly, if we differentiate this equation with respect to s and set s = rj, we'll get zero, so we have 
da db 


— + — = = à 
T Ks 0 at s r] 


We let K = —a/b, and Eq. (4.24) results. 
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Im(s) 


FIGURE 4.5 (cont.) 
Step-by-step development 
of a root locus. 


| 


Step 5: Find the Im(s) axis crossing points. 
(e) 


Step 7 : Complete the sketch. 
(f) 
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value corresponding to the breakaway point Ko = 1/4. If we let K = 1⁄4 + Kj, 
we have the locus equation 


l 
ssts+7+Ki =0 


2 


l 
ats + K,; = 0. (4.27) 


The steps for plotting this locus are, of course, the same as for any other, except 
now the initial departure of the K, locus of Eq. (4.27) corresponds to the breakaway 
point of the K locus of Eq. (4.6)! Applying the rules of departure angles to the 
double pole at s = —1/2, we find 


—2g, = —180° + 1360°, 
ob; = 90° + 1180°, 
$i» = +90°, —90° (departure angles at breakaway). (4.28) 
In this case, the arrival angles at s = —1/2 are, from the original root locus, 
along the real axis and are clearly 0° and 180°. We can derive this result from the 
idea of the continuation root locus if we allow one additional change. We consider 


the possibility that Kı is negative. In this case, we have the locus of Eq. (4.27), 
but, if Kı is negative and K = 1/4 + Kj, as Kı grows in magnitude we will trace 


the original locus back until, at K; = —1/4, we have a point corresponding to 
K = 0. Our purpose here is to find the angles along which the roots move as they 
arrive at the multiple-root location s — —1/2. Again, we apply the technique for 


departure angles, but we need the rule for negative gains. If we return to the basic 
equation 


1+ KG(s) = 0, 


it is evident that, if K is negative and real, G(s) must be positive—that is, the 
angle of G(s) must be 0°, rather than 180°. Considering this, the angles of arriv- 
al are 


20, = 0° + 1360°, 
$i.» = 0°, 180° (arrival angles at breakaway). (4.29) 


We will compute arrival and departure angles for more complicated cases in some 
of our later examples. 


STEP 7: Complete the sketch. The final locus for the third-order example is drawn in 
Fig. 4.5(f). It combines all the results found so far— that is, the real axis segment, 
the angles of departure from the poles, the number of asymptotes and their angles, 
and the imaginary-axis crossing point. 
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4.3 


Summary of Guidelines for Plotting a Root Locus 


STEP 1: Mark poles x and zeros O. 


STEP 2: Draw the locus on the real axis to the left of an odd number of real poles 
plus zeros. 


STEP 3: Draw n — m asymptotes, centered at o and leaving at angles @;, where 


- 2p 2. e «kx. 


, 


nm nm 
180? + 1360? 
od; = ——————, 1=0,1,2:::n-m-l. 
nm 


STEP 4: Compute loci departure angles from the poles and arrival angles at the 
Zeros. 


STEP 5:* Assume So = joo and compute the point(s) where the locus crosses the 
imaginary axis for positive K. 


STEP 6:* The equation has multiple roots at points on the locus where 


If so is on the real axis, these are points of breakaway or break-in. Compute 
the angles of arrival and the angles of departure for any points of multiple 
roots. 


STEP 7: Complete the locus, using the facts developed in the previous steps and 
making reference to the illustrative loci for guidance. 


Selected Illustrative Root Loci 


In order to gain facility with the root-locus method, it is helpful to sketch a number 
of locus plots and visualize the various alternative shapes a locus of a given com- 
plexity can take. As a start on this experience, we will go through the seven-step 
procedure for several cases selected for the way they illustrate important features 


* These are optional steps. 
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of root loci. As a first case, we consider the locus 1 + KG(s), where 


s+l 


i dg s?(s + p) 


(4.30) 


for various values of p. 


EXAMPLE 4.1 First we will sketch the root locus for p very large— namely, the locus for 


G(s) = (s + 1ys?. We will go through each of the seven steps of the guide- 
lines. 


STEP 1: Mark the poles and zeros on the s plane. 


Im(s) 


Re(s) 


STEP 2: Draw the locus on the real axis to the left of an odd number of poles plus 
zeros. 


Im(s) 


Re(s) 


STEP 3: Draw n — m asymptotes: 


180? — 1360? 
hı = rom mem 
= 180°. 


a does not matter, since there is only one asymptote. 
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STEP 4: Compute the departure and arrival angles. For the two poles at s = 0, 
we draw a small circle around them. The angles from the two poles are equal, 
and the angle from the zero is essentially zero, so the angle condition reduces 
to 


—20; + 0° 
$1.2 


180° + 1360°, 
—90°, +90°. 


The locus leaves vertically, one up and one down, as we indicate by arrows: 


Im(s) 


Re(s) 


STEP 5: Compute the points where the locus crosses the imaginary axis. The char- 
acteristic equation is 


s? +Ks+K =0, 


and the Routh array is 


s? l K 
s! K 
5? K. 


Since the entries in the first column are all positive if K is positive, the equation’s 
roots are all in the left-half plane on the root locus and do not cross the imaginary 
axis. 


FIGURE 4.6 
Root locus for G(s) = 
(s + 1)/s?. 


EXAMPLE 4.2 
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STEP 6: Locate the possible multiple roots according to Eq. (4.24). Here we have 


b(s) =s+1, 
a(s) = s?, 
db 

— =|: 

ds j 
da 

— = 25. 
ds s 


And the condition is 
—s?°(1) + (s + 1)(2s) = 0, 
s? +2s = 0, 
$ = 0, —2. 
The root at s = 0 corresponds to the two poles of G(s) that are on the locus at 


K = 0. The other case at s = —2 corresponds to a multiple root, since in step 2 
we found that s — —2 is on the locus. 


STEP 7: Sketch the locus as shown in Fig. 4.6. In this case, we can prove that the 
locus is, in fact, a circle, the proof being left as a problem. z 


Now we will plot the root locus for 1 + KG(s), where G(s) is given by Eq. (4.30), 
with p = 4. 


STEP 1: Mark the poles and zeros on the s plane. 
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STEP 2: Draw the locus on the real axis to the left of an odd number of poles plus 


Zeros. 


STEP 3: Draw n — m asymptotes: 


$12 


180° + 1360? 


n—m 
180? + 1360? 
a=] 
90° + 1180°; 
+90°, —90*; 
ee os 
d 
-4-—- [en 

I>] 
-— 


STEP 4: Compute the departure angles from the poles and the arrival angles toward 
the zeros. We draw a small circle around the two poles at s = 0. The angles from 
the zero at —1 and from the pole at —4 are both zero, and the angles from the two 
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poles at the origin are the same. Therefore the root-locus condition is 


—2¢; — 0° + 0° = 180° + 1360°, 
d; = —90? — 1180? 
= —90°, +90°. 


STEP 5: Assume s = jo and compute the point(s) where the locus crosses the 
imaginary axis: 
ee ee 
s?(s + 4) 
si+4s?+Ks+K =0. 


, 


Let $ — jo: 
—jo? — 4w? - Kjo +K =0. 


Set real and imaginary parts separately to zero: 


—4e? +K = 0, 
K = da’; 

—o? + Kw = 0, 
K = w 


The two equations have no solution except K = w = 0, so we conclude that the 
loci do not cross the imaginary axis for K > 0. We can confirm this finding by the 
Routh array test. In the present case, the array is 


sri ] K 
ge d K 
4, WoE 

4 
s K. 


The entries in the first column are all positive if K is positive, so the equation has 
no roots in the right-half plane for positive K. 
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FIGURE 4.7 
Root locus for G(s) = 
(s + 1)/[s?(s + 4)]. 


STEP 6: Locate the points of multiple 

break-in points: 
b(s) = 
a(s) = 
db 
ds 
da 
ds 


Substituting into Eq. (4.24), 


roots, which will include breakaway and 


$1, 
ds", 


1; 


357 + 8s. 


—(s? + 457)(1) + (s + 1)3s? + 8s) = O, 
—s? — 45? + 3s? + 11s? = 85 = 0, 


The possible locations are 


s =0 and 


25? 4-75? 4- 8s — 0, 
s(2s? + 7s +8) =0. 


s = —1.75 + j0.968. 


The root at s = 0 is on the locus and corresponds to the two poles of G(s) at 


s = 0, which are on the locus for K 


= 0. The two other roots are not on the 


Im(s) 


EXAMPLE 4.3 
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root locus and therefore do not correspond to multiple roots. To confirm this, it 
would be necessary to compute the phase of G(—1.75 + j0.97), which is not worth 


the trouble. 


STEP 7: The complete root locus drawn is Fig. 4.7. 


As a third example, we will sketch the root locus for 1 + KG(s), where 


G(s) = 


STEP 1: Mark the poles and zeros. 


g + 1 
s?(s +12) 


STEP 2: Draw the real axis loci. 


STEP 3: Draw the asymptotes: 


$, = 


180° + 1360? 


a=] 


+90°, —90?; 
esa nd n Co) 


-— 


2 


a=] 


Im(s) 


Re(s) 
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STEP 4: Compute the departure and arrival angles at poles at s = 0, $,» = +90°. 


Im(s) 


Re(s) 


STEP 5: Compute the imaginary axis crossing. The characteristic polynomial is 
s? + 12s? + Ks +K =0, 


and the corresponding Routh array is 


s? 1 K 

5^. 12 K 

i. 12K —K 
4 

5° K. 


Again, we find that the signs of the terms in the first column are all positive if K 
is positive, so there are no crossings of the imaginary axis. 


STEP 6: Locate the multiple roots: 


b(s) = s +1, 
a(s) = s? + 12s?, 
db 
ds 
d 

2 = 35? + 24s. 


ds 


4.3 / Selected Illustrative Root Loci 181 


Using Eq. (4.24) again, we find the possible points of multiple roots at the solu- 
tion of 


—(s? + 1257)(1) + (s + DGs? + 24s) = 0, 
— 5? — 125? + 35° + 27s? + 24s = 0, 
2s? + 15s? + 24s = 0. 


The roots of this equation are 


In this case, all three roots are on the locus and are thus points of multiple roots. 
The complete locus is drawn in Fig. 4.8. Note that the multiple roots at —2.31 
are at a break-in point, and at —5.18 the roots break away from the real axis, 
approaching the vertical asymptotes as K gets large. Notice that the locus both 
breaks in and breaks away at right angles. E 


FIGURE 4.8 
Root locus for G(s) — 
(s + 1y[s?(s + 12)]. 
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EXAMPLE 4.4 As the fourth example in this series based on the transfer function of Eq. (4.30), 
we consider 


st+l 


ew = s?(s +9) 


STEPS 1, 2: Mark the axes and the real axis segments. 


STEP 3: Draw the asymptotes: 

.. 180° + 1360* 
3 91 

a fee elk el 
deri 


= 907. 


—4. 


Q = 


STEPS 4, 5: Again, we have departure of the two poles at s = 0 at +90° and no 
crossing of the imaginary axis. 


STEP 6: Estimate the possible multiple roots: 


b(s) =s+1 
a(s) = $* + Ox". 
db 

— =]; 

ds 

he = 357 + 18s. 


ds 
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The possible multiple roots are at 


—(s? + 9s7)(1) + (3s? + 18s)(s + 1) = 0, 


=s? — 95? + 35° + 2157 + 185 = 0, 
25? + 1257 + 18s = 0, 
g =D =A 
Again, the points of multiple roots are on the locus, but in this case we have 
repeated roots in the derivative, which indicates not only dG/ds = 0 but 
d^G/ds? = 0, so we have three roots at the same place. Applying the rule of 
departure angles (K, > 0) to the triple root at s = —3, we find 
—34, + 180° = 4180? + 1360?, 
d XP, 120°. 


The arrival angle rule (K; < 0) to the triple root yields 
—34, + 180° = 0? + 1360°, 
od = +60°, 180°. 


STEP 7: The complete locus is sketched in Fig. 4.9. & 


If we now compare the three root loci in Figs. 4.7, 4.8, and 4.9, it is evident 
that when the third pole is near the zero, we have a modest distortion of the second- 
order locus for 1/s?. As p is increased, the distortion becomes more extreme, until, 
at p = 9, the locus breaks in at —3 in a triple multiple root. As the pole p is moved 
beyond —9, the locus exhibits distinct break-in and breakaway points, approaching, 
as p gets very large, the circle locus of one zero and two poles. The locus of Fig. 4.9 
when p = —9 is thus a transition locus between the two second-order extremes, 
which occur at p = 1 (where the zero is canceled) and p = œ (where the extra 
pole has no effect). 
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FIGURE 4.9 
Root locus for G(s) — 
(s + 1)/[s*(s + 9)]. 


EXAMPLE 4.5 This next example illustrates multiple roots off the real axis. Consider the root 
locus of 1 + KG(s), where 
l 


bi 2 s{(s +2)[(s + 0? + 4]} 


STEPS 1, 2: Mark the s plane and draw in the real axis segments. 
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STEP 3: Draw the asymptotes: 


180° + 1360° 
car d 
45° + 190° 
= 45°, 135", a5", —185*. 
oto laoee 
4—0 


--] 


Im(s) 


Re(s) 


STEP 4: We consider a test point near the complex pole at — 1 + 72. (See the figure 
at the top of page 186.) 
The angle condition on G(s) is 


—, — $2 — $3 — p4 = 180? + 1360°, 


where 
2 
| = tan ! =i = 116.6°, 
h = tan ! 2634, 


d, = unknown, 
$4 = 90°; 
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—116.6° — 63.4? — d3 — 90° = 180° + 1360°, 
—o3 = +450° + 1360°, 


= 90”, 
$4 = —90°. 
In fact, we can observe at once that along the line s = —1 + jw, $», and dj 


are angles on an isosceles triangle and always add to 180°, and $4 is 90°, so 
the entire line from one complex pole to the other is on the locus in this special 
case. 
STEP 5: Compute the crossing of the imaginary axis. The characteristic equation is 
s^ + 4s? + 9s? + 10s +K =0. 
If we try a solution for s = j@o, we find wo and K must satisfy 
eg — 4jo@% — 9w + jl0wo +K = 0. 

Equating the real and imaginary parts to zero, we get the equations 

wg — 9o, +K = 0, (i) 

—4w3 + 10w = 0. (ii) 
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From (ii), ej = 5/2 and thus wọ = 1.58. From (i) and (ii), 


K -95)- Z 


This value of K can also be verified by the Routh array. 


Im(s) 


Re(s) 


STEP 6: Locate possible multiple roots: 


db 
b =, — —( 
ds 
4 3 2 da 3 2 
a = s" + 4s + 95^ + 10s, "e pte + 125^ + 18s + 10. 

The condition reduces to da/ds = 0. We could find solutions to this cubic, but 
from step 4 we notice that the line at s = —1 + jw is on the locus, so there must 
be a breakaway at s = —1, which can be divided out. That is, we can easily show 
that 


4s? + 125? + 18s + 10 = (s + D(4s? + 8s + 10). 
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The quadratic has roots —1 + j 3/2 = —1 + 71.22. Since these points are on 
the line between the complex poles, they are true points of multiple roots on the 
locus. 


FIGURE 4.10 
Root locus for G(s) = 
l/s(s + 2)[(s + 1)? + 4]}. 


Re(s) 
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STEP 7: Using this data, we sketch the locus in Fig. 4.10. Notice that here we have 
complex multiple roots. Branches of the locus come together at —1 + j1.22 and 
break away at 0° and 180°. It is interesting to sketch the loci as the pole at —2 
is moved in to —1 and removed to —10 to see why this locus also is a transition 
between alternatives. E 


EXAMPLE 4.6 In the next two examples, we will examine the importance of the departure and 
arrival angles. The first case is a root locus typical of servomechanisms with a 
flexible load when the position sensor is on the motor shaft. The locus is 1+ K G(s), 
where 


(s + 0.1) + 16 
s[(s + 0.1? + 25] 


G(s) — 


Again, we follow the steps. 


STEPS 1, 2: 
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STEP 3: Draw the asymptotes: 


180° + 1360° : 
dim. GB 


a = not relevant. 


STEP 4: Compute the departure and arrival angles. For the arrival angle of the zero, 
the angle condition is 


—, — hı — 63 + y, + Wr = 180? + 13608, 
where 
pı = 90°; d2 = —90°; p3 = 90°; y, = 90°. 


Thus y; = 180°, and the root arrives from the left. At the pole, the departure 
angle is found from the same formula, except now $» is unknown and $, = $3 = 
Ui = Wo = 900°. Thus, 


—90° — dz — 90° + 90? + 90° = 180° + 1360°. 
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Thus, œ) = 180? (with / = 0) and departure is also toward the left. We can pause 
here and sketch in our best guess at the locus, as follows: 


C 


Im(s) 


Re(s) 


C 


At this point, we would expect to find no root crossing of the imaginary axis and 
no multiple root points. 


STEP 5: Compute the point where the locus crosses the imaginary axis. The char- 
acteristic equation is 


s? -- (K +0.2)s* + (0.2K + 25.01)s + 16.01K = 0, 
and the Routh array is 


$3: 1 0.2K + 25.01 
s*: K+0.2 16.01K 


|. (K +0.2)(0.2K + 25.01) — 16.01K 
i K +02 


s°: 16.01K. 
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EXAMPLE 4.7 


FIGURE 4.11 

Root locus for G(s) — 
[(s + 0.1)? + 16]y/[s(s + 
0.1)? + 25]. 


The leading (and only) term in the s! line is a quadratic in K equal to 0.2K? + 
9.04K + 5.0, which is clearly not zero for any positive K, so we confirm our 
previous conjecture that there is no crossing of the imaginary axis. 


STEP 6: Determine the possible multiple roots: 


b(s) = s? +0.2s + 16.01, 
a(s) = s? + 0.2s* + 25.015, 


db 
BT = is +02: 

ds s 

d 

Se css & As + 25.01, 
ds 


The formula for possible multiple roots is a fourth-degree polynomial and does not 
give enough information to be worth solving. 


STEP 7: The complete locus is sketched in Fig. 4.11. È 


For this example, we use the same basic configuration as in Example 4.6, except 
that we interchange the complex poles and zeros. We take G(s) to be 


2 
GG) =< EOD? + 25 


— s[(s + 0.1? + 16] 
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Since this example is very much like Example 4.6, we will only repeat the 
departure- and arrival-angle calculations and the imaginary-axis crossing calcu- 
lation. 


STEP 4: Compute the angles of arrival and departure. In this case, we have the 
angle condition for departure at pole 2(—0.1 + j4) as —$6; — 6» — $3 + Vi 
y; = 180° + 1360?, where d} = 4s = ys = 905;y,; = -—90?. Thus 
(with / — —1) 


—90? — $; — 90° + 90? — 90° = 180° + 1360, 
2 = 0. 


For arrival at the zero (—0.1 + j5), the angles are $; = $2 = $3 = y; = 90°, 
and the angle condition for the root locus is 


—90° — 90° — 90° + 90° + y, = 180° + 1360°, 
y; = 0°. 
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STEP 5: From step 4, we see that both departure and arrival are toward the right-half 
plane so we would expect to find a crossing of the imaginary axis. The characteristic 
equation is 


s? + (K +0.2)s? + (0.2K + 16.01)s +25.01K = 0. 
The Routh array is 


s: 1 0.2K + 16.01 
s: K+0.2 25.01K 

' K +0.2 
49: 2501K. 


In this case, stability is decided (for K > 0) by the term in the s! row. Multiplying 
this out, the imaginary axis will be crossed for real positive solutions to 


0.2K? — 8.96K + 3.20 = 0. 


FIGURE 4.12 

Root locus for G(s) = 
[(s + 0.1)? + 25]JAs[(s + 
0.1) + 16]}. 


4.3 / Selected Illustrative Root Loci 195 


These are K = 44.4 and 0.362. With these values, the frequencies may be found 
from the real part of the characteristic equation, namely, 


(K +0.2)w? = 25.01K, 


|. [25.01K 
© DALE +03 


= 4.99 and 4.01. 


Notice that the crossings are very close to the (open-loop) poles and zeros. 


STEPS 6, 7: Again, we omit the calculation of possible multiple roots and plot the 
root-locus in Fig. 4.12. E 


The major point of Examples 4.6 and 4.7 is that if the system has poles or 
zeros near the unstable boundary, the departure angles will quickly show if, in fact, 
these will cause closed-loop stability problems. Furthermore, if one compares Figs. 
4.11 and 4.12, it is obvious that shifting the relative position of poles and zeros can 
have a dramatic influence on stability. In Fig. 4.11, the zero is at a lower frequency 
than the pole and the locus stays in the left-half plane, whereas in Fig. 4.12 their 
positions are reversed, and that portion of the locus represents an unstable system 
for almost any value of K; thus the entire system is unstable for almost any value 
of K. 
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4.4 


Selecting Gain from the Root Locus 


The root locus is a plot of all possible locations for roots to the equation 1 + 
KG(s) = 0 for some real positive value of the parameter K. The purpose of 
design is to select a particular value of K that is suitable according to the static- 
and dynamic-response specifications. We now turn to the question of selection of 
K and identification of the value of the parameter that will cause the roots to be at 
specific places. Using the phase definition (II) of the locus, we developed seven 
steps to sketch a root locus from the phase of G(s) alone. If the equation is actually 
to have a root at a particular place when the phase of G(s) is 180°, a magnitude 
condition must also be satisfied. If we repeat Eq. (4.5d) we can readily see that 
this condition is 


G(s) = -5, 


which, of course, is equivalent to 


"a 
G(s) 


For values of s on the root locus the phase of G is 180°, and we can write the 
magnitude condition as 


l 
K= IGr (4.31) 
Equation (4.31) has both an algebraic and a graphical interpretation. To see 
the graphical interpretation of Eq. (4.31), consider the locus of 1 + KG(s) where, 
as seen in Eq. (4.12), 


l 


= erar 


(4.32) 


For this transfer function, the locus is plotted in Fig. 4.5, and is repeated showing 
all parts in Fig. 4.13. On Fig. 4.13, the lines corresponding to a damping ratio of 
¢ = 0.5 are sketched, and the points where the loci cross these lines are marked 
with dots (°). As we know, the locus shows all possible root locations. Suppose 
we wish to set the gain so that the actual locations of the poles are at the dots. 
This corresponds to selecting the gain so that two of the closed-loop system poles 
have a damping ratio of ¢ = 0.5. We will find the third pole shortly. The ques- 
tion is, What is K when a root is at the dot? From Eq. (4.31), the value of K is 
given by | over the magnitude of G(so), where so is the coordinate of the dot. On 
the figure, we have plotted three vectors marked so — $1, $9 — 52, and $9 — 53, which 


FIGURE 4.13 

Root locus for G(s) = 
IAs[(s + 4)? + 16]} 
showing calculation of 
gain K. 
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are the vectors from the poles of G(s) to the point so. (Since s, = O, the first 
vector equals so.) Algebraically, we have 


l 
G = — i 
(so) So [lso = 52)650 — 33)] Mine 


and, using Eq. (4.31), 


l 


= IG(so)| = Isol|so = S2||so p 53]. (4.34) 


The graphical interpretation of Eq. (4.34) shows that its three magnitudes 
are the lengths of the corresponding vectors drawn on Fig. 4.13. Hence, we can 


. 198 
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compute the gain to place the roots at the dot (s = so) by measuring the lengths 
of these vectors and multiplying the lengths together. Using the scale of the figure, 
we estimate that 


Iso] = 3.95, 
Iso — s2| = 2.1, 
Iso — s| = 7.7. 
Thus, the gain is estimated to be 


K = (4.0)(2.1)(7.7) 
= 65. 


We conclude that if K is set to the value 65, then a root of 1 + KG will be at 
$9, Which has a damping ratio of 0.5.* Another root is at the conjugate of so, 
of course. Where is the third root? From the root locus, the third branch is along 
the negative real axis. Ordinarily we would need to guess a test point, compute a 
trial gain, and correct the guess until we found the point where K = 65. In this 
case, we can use the property of the root locus discovered when we were drawing 
the locus asymptotes and expressed in Eq. (4.17) —that is, the sum of the roots is 
constant (does not change as K changes) if m < n — 1. Thus the unknown root 
must be moved far enough to the /eft to keep the sum fixed. From the figure, we 
estimate that sọ = —2.0 + 73.4. Since the starting point was at s = —4 + j4, 
this root has moved 4 — 2.0, or two units to the right. The conjugate has moved 
an equal distance, so the third root must have moved (2)(2), or four units to the 
left. Since the third root began at s = 0, it is now located at —4, where we have 
marked the spot with the third dot. 

A process with the transfer function given by Eq. (4.32) has one integrator 
and, in a unity feedback configuration, will be a Type-I control system. In this case, 
the steady-state error in tracking a ramp input is given by the velocity constant K», 
which is in this case, 


K, 


lim sKG(s) 

TOP NEN. P 

so0 s[(s + 4)? + 16] 

K 

p Es 4.35 
32 ( ) 


With the gain set for complex roots at damping ¢ = 0.5, the root locus gain K 
is 65; by Eq. (4.35) the velocity constant is K, = 65/32 = 2. If the closed- 
loop dynamic response as determined by the root locations is satisfactory and the 
steady-state accuracy as measured by K, is good enough, then the design can 


* The value (65) is, of course, an approximation but is sufficiently close that a finer tuning would have 
to be done experimentally on the actual system, since the G(s) we are using is also subject to error. 
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be completed by gain selection alone. If, as is typically the case, no value of K 
satisfies all the constraints, then additional dynamics are necessary to meet the 
system specifications. 


Dynamic Compensation: The Lead and Lag Networks 


If the process dynamics are of such a nature that a satisfactory design cannot be 
obtained by a gain adjustment alone, some modification of compensation for the 
process dynamics is indicated. While the variety of such compensation is great, two 
categories have been found to be particularly simple and effective. These are the 
lead and the lag networks.* The lead network acts mainly to modify the dynamic 
response to raise bandwidth and lower rise time and also to decrease the transient 
overshoot; in a crude way, a lead network approximates derivative control. The 
lag network is usually used to raise the low-frequency gain and thus to improve 
the steady-state accuracy of the system; the lag network is an approximate integral 
control. We will consider these schemes to improve control-system performance 
separately, starting with the lead network. 

To explain the effect of a lead network on the root locus, we consider again 
the simplest case of a second-order system with transfer function: 


maia S PE (. 

which has the root locus shown in Fig. 4.2, repeated now as the solid-line locus 
in Fig. 4.14. Also shown in Fig. 4.14 is the locus produced by D(s)G(s), where 
D(s) represents a zero added at s = —2. The modified locus is the circle sketched 
with dotted lines. Notice that the effect of the zero is to move the locus to the 
left, toward the more stable part of the plane. Clearly, if our speed-of-response 
specification calls for w, = 2, then gain alone with G(s) = l/[s(s + 1)] can only 
produce a very low value of damping ratio Z, and hence at the required gain the 
transient overshoot will be substantial. However, by addition of the zero we can 
move the locus to a position having closed-loop roots at w, = 2 and ¢ = 0.5. We 
have “compensated” the given dynamics by use of D(s) = s +2. 

The trouble with compensation with a zero is that the physical realization of a 
transfer function s + 2 can only be approximate, and the inevitable high-frequency 
noise present at the input to the D(s) will be greatly amplified by such a transfer 
function. However, since the effect of the zero is most important near w, = 2, 
the action of the compensation will not be greatly reduced if a higher-frequency 
pole is added, perhaps at s = —20 to give D(s) = (s +2)/(s + 20). The resulting 
transfer function is that of a lead network. 


* The names of these devices are derived from their frequency (sinusoidal) responses, where the output 
leads the input in one case (positive phase shift) and lags the input in the other (negative phase shift). 
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FIGURE 4.14 

Root locus for KG(s) = 
K/[s(s + 1)], with an 
additional zero 

KpG(s) = [K(s + 
2)\/[s(s + 1)]. 


To see the effect of the pole on the compensation, the root loci for two cases 
are shown in Fig. 4.15(a and b). In Fig. 4.15(a), the root locus is sketched for 
D(s) = (s + 2)(s + 20), and in Fig. 4.15(b), the locus is sketched for D(s) = 
(s + 2)/(s + 10). The important fact about these loci is that for small gains, before 
the real part of the root reaches —2, they are almost identical with the locus of 
Fig. 4.14, where D(s) = s +2. To emphasize this point, in Fig. 4.15(c) all three 
loci are superimposed on the same plot. As can be easily seen from that figure, 
the effect of the pole is to press the locus toward the right, but for the early part 
of the locus, the effect of the pole is not great. 

The method of selection of the pole and zero of the lead network can be 
made more analytical if we select the desired closed-loop pole location first. Then 
we select the zero of the lead-network on the basis of overshoot response and 
use the root-locus angle condition to select the pole. The method can be illustrated 
by the same plant. Suppose we wish to force the root locus to pass through the point 
-=I + j Ja corresponding to w, = 2, ¢ = 0.5. The corresponding s plane is 
sketched in Fig. 4.15(d). The root-locus angle condition is satisfied if the angle & 
(the net contribution of the lead pole and zero) is 30°. (The reader should verify this 
claim.) Thus, if we place the zero at —2 (we expect an overshoot of about 30%), 
the closed-loop pole will be at —1 + j J3 if the lead network pole is at —4. Other 
combinations of lead zero and pole can also be selected that yield the required 
30°; the angle criterion for a specific closed-loop pole location only specifies the 
relationship between the pole and zero. 
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FIGURE 4.15 

(a) and (b): Root loci 
for two specific cases of 
G(s) = l/[s(s + 1)]. 


(a) 


(b) 
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FIGURE 4.15 (cont.) 

(c) Root loci for three 
compensators for G(s) — 
l/[s(s + 1)]; and (d) 
construction for a specific 
point on the root locus. 


FIGURE 4.16 
Circuit of a lead network. 
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As stated earlier, the name “lead network” is a reflection of the fact that 
to sinusoidal signals these transfer functions impart phase lead. The details of 
this will be treated in Chapter 5, but we can quickly point out here that the 
phase of 


= 
D(s) = —— 
Stp 
at s = jw is given by 
ġ = tan! E n tan ! n (4.36) 
Z p 


If z <p, $ is positive, which is, by definition, phase lead. 

The selection of exact values of z and p in particular cases is done by experience 
and by trial and error. In general, the zero is placed in the neighborhood of the 
closed loop «,, as determined by rise-time or settling-time requirements, and the 
pole is located at a distance from 3 to 10 times the value of the zero location. 
The choice of pole location is a compromise between the conflicting effects of 
noise suppression and compensation effectiveness. In general, if the pole is too 
close to the zero, then, as seen in Fig. 4.15(c), the root locus moves back too far 
toward its uncompensated shape, and the zero is not successful in doing its job. 
On the other hand, if the pole is too far to the left, the magnification of noise at 
the output of D(s) is too great and the motor or other actuator of the process will 
be overheated by noise energy. 

The physical realization of a lead network can be accomplished in many ways. 
A most common method is by means of an operational amplifier, of which an 
example is shown in Fig. 4.16. The transfer function of the circuit of Fig. 4.16 is 
readily obtained as 


Tis +1 


Dis) e =e 
(5) DaTus +1 


(4.37) 


E Rr 
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where 
Rr 
Kp = =] if Rr = Ri + R, 
D = RER, F l 2 
Ti = R iC , 
R2 
Ri + Ro l 
Notice that the zero is located at z = —1/T, and that the pole is located at 
p = —MaTi|, so the parameter œ sets the separation distance between pole and 


zero, typically a factor of 3 to 10. 

Once satisfactory dynamic response has been obtained, perhaps by the use 
of one or more lead networks, the designer may discover that the low-frequency 
gain —the value of the relevant steady-state error constant such as K , — may be still 
too low. In order to increase this constant, the equivalent of another integration at 
near-zero frequency is indicated. The improvement is thus made by a pole near 
s = 0, but usually we include a zero nearby so that the pole-zero pair (called a 
dipole) does not significantly interfere with the overall system dynamic response as 
determined by the lead network(s). Thus, we want a D(s) that has significant gain 
at s = 0 to raise K, (or another steady-state error coefficient) and that is nearly 
unity (no effect) at the higher frequencies where dynamic response is determined. 
The result is the transfer function 


$ +z 


D(s) = (4.38) 


Sp 
where z and p are small (perhaps z = 0.1 and p = 0.01), yet D(0) = z/p = 10— 
or generally in the range of 3 to 10, depending on the extent to which the steady- 
state gain requires boosting. The transfer function of Eq. (4.38) with z > p has 
phase given by Eq. (4.36), but now, since z > p, ó is negative, corresponding to 
phase lag. Hence, the device with this transfer function is called a /ag network. 

The effects of a lag network on dynamic response can also be studied by 
looking at the corresponding root locus. Again, we take G(s) = l/[s(s + 1)], 
include the lead network Dj(s) = (s + 2)/(s + 20), and raise the gain until the 
closed-loop roots correspond to a damping ratio of ¢ = 0.707. At this point, 
marked with a dot on Fig. 4.17(a), the root locus gain is about 31. Thus, the 
velocity constant is 


K, = lim sKDG 
s+2 l 
a mO aea 
mn ED sr T 
8 
^». 10 


Boks 


FIGURE 4.17 

(a) Root locus with both 
lead and lag networks. 
(b) Expanded scale to 
show the root due to the 
lag network. 
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Suppose we now add a lag network of D(s) = (s + 0.1)/(s +0.01) to give an 
increase in velocity constant of about 10. The root locus is plotted in Fig. 4.17. 

In Fig. 4.17(a), the locus is plotted showing the dominant roots at —1.35 + 
j1.35. Notice the very small circle near the origin, however. This region is ex- 
panded in Fig. 4.17(b) and is seen to be a result of the lag network. Notice that 
a closed-loop root remains very near to the lag-network zero at —0.1 + j0. This root 
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FIGURE 4.18 


Circuit diagram of a lag 


network. 


o 4.6 


will correspond to a very slowly decaying transient, which has a small magnitude 
because the zero will almost cancel the pole in the transfer function. Still the decay 
is so slow that this term may seriously influence the settling time. Because of this 
effect, the lag pole-zero combination is placed at as high a frequency as possible 
without causing major shifts in the dominant root locations. Also important to 
notice is the fact that the transfer function from a plant disturbance to system error 
will not have the zero, and thus disturbance transients can be very long in duration 
in a system with lag compensation. A circuit diagram of a lag network is given in 
Fig. 4.18. The transfer function of this circuit is easily shown to be 


ppc d aa» 
where 
T = R,C, 
= R2 
R, + R2 
Usually R; = R2, so the high-frequency gain is unity, but some gain adjustment 


can be made by other selections for R;. 


Extensions of the Root Locus 


The root-locus technique is a graphical scheme to show locations of possible roots 
of an equation as a real parameter varies. Thus far, we have considered only poly- 
nomial equations, control-system loop gain as the parameter, and positive values 
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of the gain as possibilities. Each of these assumptions can be altered to guide us 
to a far wider range of applications of this useful technique. 


4.6.1 Time Delay 


Consider first the problem of design of the control system for a heat exchanger 
described by the transfer function 


e 5s 


GG) = 0s 4 1605 +) 


(4.40) 
The delay term is caused by the temperature sensor being physically somewhat 
downstream from the exchanger so that its reading is delayed a few seconds. The 
corresponding root-locus equations would be 


1+ KG(s) = 0, 
es 
i+ ge £s Ü, 4.1 
(10s + 1)(60s + 1) ied 
600s? + 70s +1 + Ke™ = 0. (4.41) 


Equation (4.41) is not a polynomial and thus does not fall in the same class as our 
other examples so far. How would one plot the root locus corresponding to Eq. 
(4.41)? There are two basic approaches, which we will describe: approximation 
and direct application of the phase condition. 

In the first approach, we reduce the given problem to one we have previously 
solved by approximating the nonrational function e ?* with a rational function. 
Since we are concerned with control systems and typically with low frequencies, 
we want an approximation that will be good for s = O and nearby.* The most 
common means used to find such an approximation is attributed to Padé and is based 
on matching the series expansion of the transcendental function e ?* with that of 
a rational function, a ratio of numerator polynomial of degree p and denominator 
polynomial of degree q. The result is called a (p, q) Padé approximant to e~>’. 
For our purposes, we will consider only the case p = q. Also, for generality, we 
will compute the approximants to e ^, and in the result 7s may be substituted for 
s to allow for any desired delay. 

To illustrate the process, we begin with the (1,1) approximant. In this case, 
we wish to.select bo, bı, and do so that the error 

E bos + bj 


= m 4. 
e ar E (4.42) 


is small. For the Padé approximant, we expand both e ? and the rational func- 


*The nonrational function e? is analytic for finite s and so may be approximated by a rational 


function. If nonanalytic functions such as /s are involved, great caution is needed. 
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TABLE 4.1 
Three Padé 
Approximants 
toe" 


tion into a McLauren series and match as many initial terms as possible. The 
series are 


s? s) sí 
"21]-selLl-LI-L-.e 
e "r ) 
bos + b 
ot Pa = b, + (bo — agbi)s — ag(bo — aobi)s? 
aos + 1 


T ac(bo - aobj)s? qe hae, 


Matching coefficients, we must solve the equations 


b, = i. 
bo em aob] = aad © 
l 
—ao(bo — agbi) = 5 


l 
ac(bo = aob;) = 
6 
Now we notice that we have an infinite number of equations but only three pa- 
rameters. The Padé approximant results when we match the first three coefficients, 
from which we obtain 
2 L= (5/2) 
| 1-(s/) 


-5S 


(4.43) 


If we assume p = q = 2, we have five parameters, and a better match is 
possible. The first few approximants are given in Table 4.1. 

The comparison of these three approximants is best seen from their pole-zero 
configuration and use in a root locus (Fig. 4.19). The locations of the poles are 
shown in the left-half plane; the zeros are in the right-half plane at the reflections 
of the poles. A root locus for the heat exchanger is drawn in Fig. 4.20 using the 


H,(s) 


|] —(sfZ) 
1 + (s/2) 
1 — (s/2) + (s?/12) 
1 + (s/2) + (s?/12) 
1 — (s/2) + (s?/10) — (57/120) 
1 + (s/2) + (s2/10) + (53/120) 


FIGURE 4.19 

Poles and zeros of the 
Padé approximants to 

e *. The order is marked 
as a superscript—that is, 
x? for the (2,2) 
approximant. 
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CD 


(2,2) approximant to e ?*. For comparison, the exact locus is also drawn. Notice 
that for low gains and up to a damping ratio of about 0.5, the two curves are very 
close. However, the Padé curve crosses the imaginary axis at o = 1, while the 
true curve crosses the imaginary axis at w = 1.4. If greater accuracy is required, 
the (3,3) approximant or even a higher order can be used. 

While the Padé approximation leads to a rational transfer function and is es- 
pecially useful for analog-computer simulation, it is not necessary for plotting a 
root locus. The phase-angle condition is not changed if the process is nonrational, 
so one still must search for values of s for which the phase is 180? + /360?. If we 
write the transfer function as 


G(s) = e ^G(s), 


the phase of G(s) is the phase of G(s) minus Aw for s = o + jo. Thus, one 
can formulate a root-locus problem as searching for locations where the phase of 
G(s) is 180? + Aw + 1360°. To sketch such a locus, one would fix w and search 
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FIGURE 4.20 
Root locus for heat 
exchanger. 


Exact locus 


--- Using (2,2) Padé 
approximant 


along a horizontal line in the s plane until a point is found, then raise w, change 
the target angle, and repeat. Similarly, the departure angles are modified by Aw, 
where w is the imaginary part of the pole where the departure is being computed. 
A more convenient method, and the means by which the exact plot of Fig. 4.20 is 
obtained, is to have a computer program that performs the search. 

Before leaving the topic of systems with delay, it is interesting to consider the 
matter of where the loci of such systems cross the imaginary axis. Consider the 
loci of 


-=F 


Sasi (4.44) 
S 


FFA 


For s = jw, the phase condition may be written as 


—90? — w = — 180° — 1360°, 
w = 90° + 1360? 
= - + 12m. (4.45) 
Equation (4.45) follows from the fact that the phase of e |" is —w, and foro = 0, 
the phase of 1/s is 90°, or 7/2. Ato = —® (far, far into the left-half plane), the 
phase of 1/s is 180°, so the root-locus formula for phase is 
—180° —w = —180? — 1360°, 
w = 1360° (4.2) 


= 127. (4.46) 


FIGURE 4.21 

Sketch of root locus 
for system with delay 
G(s) = e "Is. 
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Finally, for @ = +æ (far to the right), the phase of 1/s is 0°, so the root-locus 
angle condition is 


—w = —180° — 1360, 
w = 180° + 1360? (4.3) 
= m + 127. (4.47) 


If we combine Eqs. (4.45), (4.46), and (4.47), we obtain the locus sketched in 
Fig. 4.21. Notice that there is an infinity of branches of this locus, from left (where 
e ^ = o) to right (where e^* is zero). Of course, the principal branch of this 
locus starts at s = 0, has a breakaway at s = — 1, and crosses the imaginary axis 
at j(7/2), going to the horizontal asymptote at s = jr. 


4.6.2 Loci versus Other Parameters 


A second extension of the root locus, discussed in the chapter introduction but 
beyond the developments detailed so far, is to consider parameters other than loop 
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FIGURE 4.22 

Block diagram of a 
servomechanism 
structure including 
velocity, or tachometer 
feedback. 


gain. The key idea of the root locus is that the locus is a plot of solutions to 
1+ KG(s) = 0 (4.48) 


for some real K and given G(s). Consider another parameter. A block diagram of 
a relatively common servomechanism structure is shown in Fig. 4.22. In this case, 
a speed-measuring device has been added (a tachometer), and the problem is to 
use the root locus to guide the selection of Kr, the tachometer gain, as well as 
Ka, the amplifier gain. We assume that the amplifier gain has already been set to 
4 at this point. Of course, a root locus with respect to K4 is the standard case we 
have been dealing with all along. We take the view that a principal function of Kr 
is to influence the closed-loop system poles, and thus we will consider the locus 
of these roots as Kr is varied. The characteristic equation of the system of Fig. 
4.22 is 


4 Kr 


+ —————— + —— = 0, 
s(s+1) s+1 


which is not in the standard 1 + KG(s) form. However, if we clear fractions, the 
characteristic polynomial is seen to be 


st +s +tA+Krs = 0. (4.49) 


Now Eq. (4.49) is in suitable form for a root-locus study. We need to identify 
G(s), which we do by writing the equivalent to Eq. (4.49) as 


1-K (4.50) 


S 
T$ STA j 
Thus, for root-locus purposes, the “zeros” are at s = 0, and the “poles” are at 
—1/2 + j1.94. A sketch of the locus is shown in Fig. 4.23. The designer is now 
free to select Kr for a specific damping ratio or whatever else might guide the 
selection of Kr. Having selected a trial value of Kr, one could return to K4 and 
consider the effects of a change from 4 in that parameter. With respect to K4 the 
locus is governed by Eq. (4.49). If Kr = 1 is selected, and we wish to consider 
changes from the nominal value of K4 = 4, the equation can be written as 


s*+(1+Kr)s+4+K =0, 
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FIGURE 4.23 Im(s) 


Root locus of closed-loop 
poles of the system in 
Fig. 4.22 vs. Kr. 


| Re(s) 


where we have taken K + 4 = Ky. With respect to K, the locus (for Kr = 1) is 
governed by 


s°+2s+4+K =0. (4.51) 


Now we see that the “poles” of the locus corresponding to Eq. (4.51) are the roots 
of the previous locus, which was drawn versus K7! The situation is sketched in 
Fig. 4.24, with the previous locus versus Ky left dotted. It should be clear that one 


FIGURE 4.24 
Root locus vs. K after 
Kr is selected to be 1. 


locus vs. Ky at Ka=4 


s vs. K at Kp -1 
K 4 =K+4 


d 
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could draw a locus versus K for a while, stop, resolve the equation, and continue 
the locus versus Kr; in other words, one could go back and forth between these 
parameters at will! To summarize, the technique for handling any single parameter 
is to write out the characteristic equation, collect terms that do not multiply the 
parameter as a(s), and collect terms that do multiply the parameter as b(s). After 
this formulation stage, the root locus proceeds as before. 


4.6.3 Zero-Degree Loci for Negative Parameters 


We now consider the extension of the root locus to consider negative values of the 
parameter. We have already briefly seen this case when we worked out the angles 
near a multiple root point. In the case of the example servomechanism considered 
in Fig. 4.22, we sketched a root locus versus K, where Ką = 4 + K. It would 
seem reasonable to consider values of K 4 less than 4 as well as values of K 4 greater 
than 4. In order to make Ķ4 less than 4 we need to make K negative. What are the 
rules for a root locus with a negative parameter? Consider again the basic equation 


l + KG(s) = 0. (4.52) 


If this time we ask that Eq. (4.52) be satisfied for negative values of K, it must 
be that G(s) is real and positive. In other words, for the negative-parameter root 
locus (or negative locus), the condition is 


The angle of G(s) is 0° + 1360° for s on the negative locus. 


The steps for plotting a negative locus are essentially the same as for the 
positive locus except that we search for 0° modulo 360° instead of 180° modulo 
360°. To return to the servomechanism case, consider again the problem of Eq. 
(4.51). The negative locus is sketched in Fig. 4.25. This time, we find that the 
locus is to the left of an even number of real poles plus zeros (zero being even). 
For an angle of 0°, the departure angle from the complex root at —1 + j1.73 is 
—90°. Computation of the asymptotes for large s is 


ap = =Pi~2=Z us before), (4.53) 
n-m 
but the angles are modified to be 
0° 
à; = m r shifted by 180° from 180° locus. 


To complete the extension, we repeat the guidelines for plotting a negative- 
parameter root locus. 
1. Mark the n poles as x and the m zeros as O. 


2. Draw the locus on the real axis to the left of an even number of real poles plus 
Zeros. 


FIGURE 4.25 

Negative root locus 
corresponding to G(s) = 
l/(s? + 2s + 4). 
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3. Draw n — m radial asymptotes centered at œ and with angles $; where 


_ 2Pi7 27% |a tb 
nm nm ’ 
1360? 


bı = í l = 0,1,2,3,..., n-m- LL 


#- m 
4. Compute departure angles from poles and arrival angles to zeros by searching 
for points around the pole or zero, where the phase of G(s) is 0°. 


5. Assume s = j«o and compute the points where the locus crosses the imaginary 
axis for negative K. 


6. The equation has multiple roots at points on the locus [where the angle of G(s) 
is 0? modulo 360°] where, in addition, dG/ds = 0 or 


7. Fill in the locus using these calculation guides, and the locus is complete. 


The result of the extension of the guidelines for construction of root loci to 
include negative parameters is that we can visualize the root locus as a set of contin- 
uous curves showing the location of possible solutions to the equation 1 + KG(s) 
for all real K, both positive and negative. Furthermore, the continuity of these 
curves encourages us to imagine a root starting at a pole of G(s) and moving along 
a curve (a branch of the root locus) until the parameter has some value Ko. If we 
now let K = Ko + K, a new locus with respect to K is just the continuation of 
the old locus with the same zeros, but with the roots of 1 + Ko9G(s) = O as the 
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FIGURE 4.26 

Nonlinear elements 

with no memory: 

(a) saturation, (b) relay, 
(c) relay with dead 
zone, (d) gain with dead 
zone, (e) preloaded 
spring or coulomb plus 
viscous friction, and 

(f) quantization. 


(a) (b) 


(c) (d) 


(e) (f) 


FIGURE 4.27 
General shape of 
equivalent gains of 
saturation. 
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new set of poles. Thus, we visualize the roots moving along the locus branches; 
the sensitivity of the closed-loop poles to the parameter K at K = Ko is given by 
how the roots move for both positive and negative K for K = Ko + K. 


4.6.4 Use of the Root Locus in the Analysis of Nonlinear Systems 


As we have tried to make clear, every real control system is nonlinear, and the linear 
analysis and design methods we have described are used with linear approximations 
to the real models. There is, however, one important category of nonlinear systems 
for which some significant analysis (and design) can be done. These are the systems 
in which the nonlinearity has no dynamics and is well approximated as a gain that 
varies as the size of its input signal varies. Sketches of a few such nonlinear 
characteristics and their common names are shown in Fig. 4.26. 

The sketches suggest symmetry of these functions that is not really necessary 
to use the tools to be described. The behavior of systems containing any one of 
these zero-memory nonlinearities can be qualitatively described by considering the 
nonlinear element as a signal-dependent varying gain. 

For example, with the saturation element, it is clear that for input signals of 
magnitudes less than a, the nonlinearity is linear with gain N/a. However, for 
signals larger than a, the output size is bounded by N, while the input size can get 
much larger than a. It is clear that the ratio of output to input goes down, and thus 
saturation has the gain characteristics shown in Fig. 4.27. We will see presently 
that one can make an analytical definition of equivalent gain that results in an exact 
plot of Keq versus |u|, but for the qualitative results desired here the shape shown 
is adequate. 

To illustrate the method with an example, consider the system shown in Fig. 
4.28. The root locus of this system versus a gain at the location of the saturation 
is given in Fig. 4.29. At a gain of | (the saturation gain for inputs less than 0.4 in 
magnitude), the damping ratio is = 0.5. As the gain is reduced, the locus shows 
that the roots move toward the origin of the s plane with less and less damping. 
Plots of the step responses of this system with input steps of size 2, 4, 6, 8, 10, 
and 12 are given in Fig. 4.30. Notice that as the input gets larger, the response 


Nfa 


a lul 


FIGURE 4.28 
Dynamic system with a 
gain in saturation. 


FIGURE 4.29 

Root locus of system 
in Fig. 4.28, with 
equivalent gain in 
location of saturation. 


FIGURE 4.30 

Step responses of system 
in Fig. 4.28 for various 
input step sizes. 
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FIGURE 4.31 
Block diagram of a 
conditionally stable 
system. 


FIGURE 4.32 
Root locus for system in 
Fig. 4.31. 
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has more and more overshoot and slower and slower recovery. This is exactly as is 
explained by movement on the root locus with less and less gain, as if the larger 
signals resulted in a smaller equivalent gain of the saturation element. 

As a second example of a nonlinear response described by signal-dependent 
gain, consider the system whose block diagram is drawn in Fig. 4.31 and whose 
characteristic-equation root locus is plotted in Fig. 4.32. From this locus, it is 
readily calculated that the imaginary axis crossing occurs at wọ = 1 and K = 1/2. 
Systems such as this, which are stable for (relatively) large gains but unstable 
for smaller gains, are called conditionally stable systems. If our analysis is right, 
the system should show response corresponding to a damping action of about 0.5 
for small signals, get worse as signal strength is increased, and go unstable with 
oscillations near 1 rad/s for larger signals. Plots of step responses for input steps of 
size 1, 2, 3, and 3.4 are drawn in Fig. 4.33. These responses confirm the qualitative 
description above. 

As this system goes unstable, the period is very near 277, as predicted from 
the consideration of the saturation as a variable gain. However, we have no real 
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FIGURE 4.33 
Step responses of system 
in Fig. 4.31. 


FIGURE 4.34 
Block diagram of a system with oscillatory mode. 


basis for predicting that the system will go unstable for a step input of size 3.4 but 
not for a step of size 3. We will return to this point later. 

The final illustration of the use of the root locus to give a qualitative descrip- 
tion of the response of a nonlinear system is based on the block diagram seen 
in Fig. 4.34. This system is typical of electromechanical control problems where 
the designer perhaps at first is not aware of the oscillatory mode, shown here at 
w = | and ¢ = 0.1. The root locus for this system is sketched in Fig. 4.35. 
The imaginary-axis crossing can be verified to be at wọ = 1, Ko = 0.2; thus the 
gain of 0.5 is enough to force the roots of the oscillatory mode into the right-half 
plane, as shown by the dots. Here our analysis predicts an unstable system but a 


1 
s*+0.2s+1 


FIGURE 4.35 
Root locus for system in 
Fig. 4.34. 
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system that becomes stable as gain decreases. Thus, we would expect the response 
to build up until the equivalent gain is 0.2 and then stop growing! 

Plots of the step responses for three steps of size 1, 4, and 8 are shown in 
Fig. 4.36, and again our heuristic analysis is exactly correct: The error builds up 
to a fixed amplitude oscillation at 1 rad/s and holds this amplitude at any DC 
equilibrium value (1, 4, or 8). 

In this case, the response always approaches a periodic solution of fixed am- 
plitude known as a limit cycle. (The response is cyclic and is approached in the 
limit as time grows large.) In 1950, Dr. Kochenburger proposed that, for this sit- 
uation, the Fourier series be used to define the equivalent gain in the following 
way (Truxal, 1955, p. 566). For all the nonlinear characteristics of Fig. 4.26, if 
the input u(t) is sinusoidal of amplitude A, the output y(t) will be periodic with 
a fundamental period equal to that of the input and consequently with a Fourier 
series y(t) = >); b, cos(nwot + dn). 

Kochenburger suggested that the nonlinear system could be described by the 
first fundamental component of this series as if it were a linear system with gain 
b,/A and phase $,. He called this approximation the describing function. Com- 
putation of the describing function for the nonlinear characteristics of Fig. 4.26 
is generally straightforward but tedious. The simple case is the relay where the 
output is a square wave of amplitude N for every size input; thus bj; = 4N/7* 


*From the theory of Fourier series, 


1/2 l 4N 
b, = | (N sin 27rt)dt -xn Í (sin2mrt)dt = —. 
0 1/2 TT 
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FIGURE 4.36 
Step response of system 
in Fig. 4.34. 


and K,, = 4N/mA. From the root locus of our example (Fig. 4.35), the gain at 
the imaginary-axis crossover is 0.2; if we approximate the saturation as a relay, we 
have the gain as Kz, = 0.2. Also, in this case, N = 0.1, so, substituting values, 


B 2 (4)(0.1) 
Keg — 0.2 ae TÀ . 
Thus 
D _ 2 _ 
A= 0.2)m cl -ig 0.636. 


By measurement on the time history of Fig. 4.36, the amplitude of the oscillation 
has magnitude 0.65, an excellent agreement considering that the saturation was 
approximated as a relay! 

Using Kochenburger’s describing function, we can return to Fig. 4.33 and be 
easily convinced that the first transient to a step of size 3 is nearly a sinusoid. We 
can predict that the system is just on the border of stability for the equivalent gain 
corresponding to a root-locus gain of 1/2 when the locus crosses into the right-half 
plane. 
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FIGURE 4.37 
Block diagram of a system including a “notch” network. 


1 
s*+0.2s+1 


s*+0.18s+0.81 
(s+10)? 


As an example of the use of this method in design, our analysis of the system 
shown in Fig. 4.34 would suggest that the limit cycle will not occur if the root 
locus can be kept in the left-half plane. This can be done by addition of a “notch” 
network, as shown in Fig. 4.37, for which the root locus is given in Fig. 4.38 
and the step responses in Fig. 4.39. These figures show plainly that the analysis is 
borne out by the simulation. 


FIGURE 4.38 
Root locus of system in 
Fig. 4.37. 
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FIGURE 4.39 
Step responses of system 
in Fig. 4.37. 


u, control 


y, output 


o 4.7 Computer-Aided Graphing of the Root Locus 


In order to use the root locus as a design tool and to verify computer-generated loci, 
it is very important to be able to sketch root loci. One can then quickly predict, 
for design purposes, the effect of an added zero or pole, or even several of them, 
or can quickly confirm computer output in a qualitative sense. For this reason, 
the engineer needs to understand the guidelines for sketching loci and should be 
able to plot example loci by hand. Given this skill, it is valuable to have the aid 
of a computer in determining accurate loci, in establishing exact values for the 
parameters, and especially in computing the closed-loop pole sensitivity to those 
parameters, the values of which may be known only to a certain tolerance at the 
time of the design and may be subject to drift over the life of the system. 
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There are two basic approaches to machine computation of the root locus. In 
the first approach, the root-locus problem is formulated as a polynomial in the form 
a(s) + Kb(s) = 0, and for a sequence of values of K varying from near zero to 
a large value, the polynomial is solved for its n roots by any of many available 
numerical methods. This method has the advantage that all roots are computed for 
each value of the parameter, and one can be sure to guarantee that a specific value 
is included — for example, that value of the loop gain that gives the design velocity 
constant. One of the disadvantages of the method is that the resulting root locations 
are very unevenly distributed in the s plane. For example, near a point of multiple 
roots, the sensitivity of the root locations to the parameter value is very great, and 
the roots just fly through such points. On the other hand, near a zero the root moves 
very slowly, since it takes an infinite value of the parameter to push the root all the 
way into the zero. A second disadvantage of this method is the requirement that 
the problem be a polynomial. As we saw, with pure time delay a transcendental 
equation is involved, and an approximation such as the Padé method must be used 
to reduce the given problem to an equivalent polynomial. Such approximations 
limit the range of values of the parameter for which the results are accurate, and 
checking the accuracy is difficult unless a means is available to solve the true 
equation at critical points. A final disadvantage is that many algorithms are not 
easily applied in solving polynomials at points of multiple roots. This problem 
is related to the great sensitivity of the roots to the parameter at these points, 
as mentioned earlier. A method related to polynomial solving is possible when a 
state-variable formulation of the equations of motion is available. In terms of state 
variables, an idea to be treated in Chapter 6, the closed-loop poles are eigenvalues 
of the state matrix, and computer scientists have developed an algorithm called QR 
that can be used with great accuracy to solve problems of substantial complexity. 
For systems described by high-order ordinary differential equations, this is the most 
powerful method available. 

The alternative to polynomial solving is a method based on curve tracing. The 
basic idea is that a point on the positive root locus is a point where the phase of 
G(s) is 180°. Thus, given a point on the locus at sọ with parameter values Ko, 
one can draw a circle of radius 6 around sg and search for a new place where the 
angle condition is met and the new gain is larger than Ko. This method can be 
easily arranged to include a delay term as e ^, and the resulting points will be 
spaced 6 radians apart, a value that the designer can specify. One disadvantage of 
this method is that only one branch of the locus is generated at a time (although 
computer logic can be easily set up to step through each of the open-loop poles 
to produce a complete graph). A second disadvantage of the method is that the 
designer needs to monitor the selection of 5 in order to ensure convergence of the 
search for 180? at some points and to avoid wasting too much time with a small 6 
at less critical points. With either method, it is very important to have a means to 
graph the results, since the essential information in the locus is graphical. 
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Problems 


Many of the root loci plotted in this chapter were plotted by a computer pro- 
gram developed at Stanford and, in this case, implemented on the HP-85. Other 
programs that include root-locus capability are CTRL-C of System Control Tech- 
nology; MATRIXx of Integrated Systems, Inc.; CC of Systems Technology, Inc.; 
and Matlab by the Mathworks, Inc. 


Summary 


In this chapter, we have discussed a very useful graphical technique for studying the 
effect of the changes of a real parameter on the poles of the closed-loop system. 
Most often the parameter is the open-loop gain, and hence the root locus is a 
plot of the closed-loop poles parameterized as a function of the open-loop gain. 
The root locus can be viewed as a general technique for the graphical solution 
of any polynomial. Two types of root loci have been discussed: the 0? and the 
180? root locus. Although the 180? locus is encountered most often in feedback 
control systems, it is useful to understand the concept of the 0? locus, and it will 
be discussed again in Chapter 6. A seven-step procedure has been outlined for 
plotting either locus; it allows a designer to sketch quickly a root locus without 
any computer aids. This in turn facilitates the search for many different candidate 
solutions in the synthesis process: different gains, different pole-zero placements 
for a lead or lag network, different feedback variables, and different characteristics 
of the sensor, actuator, and plant. 

The root loci of systems with time-delay and nonlinearities have been dis- 
cussed, and we have demonstrated the utility of the method in the design of much 
larger systems than the linear, rational transfer function systems discussed through 
most of the chapter. Finally, some of the considerations involved in implementing 
the root locus in a computer-aided design procedure have been addressed. 


Section 4.2 


4.1 Set up the following characteristic equations in the form suited to the Evans root-locus 
method: 


a) s + (1/7) = O versus the parameter 7; 
b) s? + bs +b+1 = O versus the parameter b; 
€) (s + b + A(Ts + 1) = 0: 


(1) versus the parameter A. 

(2) versus the parameter T. 

(3) Can you set it up versus the parameter b? Why not? Can a locus be drawn 
versus b for given constant values of A and 7? Explain. 
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4.2 Roughly sketch the root loci for the pole-zero maps shown in Fig. 4.40. Show asymp- 
totes, centroids, a rough evaluation of arrival and departure angles, and the loci for 
positive values of the parameter K. Each map is from a characteristic equation of the 
form 

1+K A e 0, 
a(s) 
where the roots of the numerator b(s) are shown as small circles, and the roots of the 
denominator a(s) are shown as X's on the s plane. 


4.3 Consider the root locus for the equation 


K 
—— =|) 
s[(s + 1)(s + 5)] 


a) Show the real-axis segments clearly. 
b) Sketch the asymptotes for K — ^e. 
€) For what value of K are the roots on the imaginary axis? 


(b) (c) 


(e) (f 
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4.4 Sketch the root locus for the following systems versus K. Be sure to give the asymp- 
totes, arrival and departure angles, and imaginary-axis crossings, if any. 


a) KG(s) = ETE 

b) KG(s) — T 

c) KG(s) — META 

d) KG(s) — NCES EES 
e) KG(s) = oo. 


s4 


4.5 Sketch the root locus for the following systems versus K. 


a) KG(s) = LI 

b) KG(s) = aaa 
o KG(s) = M 

d) KG(s) = XY QS 

e KG(s) = d 

f) KG(s) = "T 


4.6 Sketch the root locus for the following systems versus K. 


K[(s + 1.5)(s + 4)] 


a) ROB) = Ie F Ie +25 

_ Kits +155 +S 
b) KG(s) = (s 4 0.5)(s + 2)(s + 3) 
c) KG(s) = — 


s[(s — Ds? + 2s + 5)] 

4.7 Sketch the complete root locus for the following systems versus K. 
K(s + 2) 

s[(s + 0.1)(s? + 2s + 2) 


2K 
s(s? + 6s + 13) 


a) KG(s) = 


b) KG(s) = 


FIGURE 4.41 


FIGURE 4.42 


4.8 


4.9 


4.10 


4.11 
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2K(s? + 2s +2) 


c) KG(s) = TEES EES 
_ —_Ki(s + 0.55 +1.5)) 

d) KG(s) = s[(s2 +25 + 2)(s + 5)(s + 15)]: 

DEG m 2514 * Dis ^3, 


s[G + DG + 3)(s? + 5)] 


a) For the system given in Fig. 4.41, plot the root locus as the parameter K , is varied 
from 0 to © with A = 2. 

b) Repeat (a) with A = 5. What is special about this value? 

c) Repeat (a) for Kı = 2 and A varying from 0 to œ. 

Determine Evans’ root-locus form of the characteristic equation for the control system 

shown in Fig. 4.42, with 5 as the parameter of interest. Sketch the root locus to scale, 

showing the direction of increasing b on the locus. 


Prove that a combination of two poles and one zero to the left of both of them on the 
real axis results in a root locus that is a circle centered at the zero with radius given 


by J/\(pi — =)|\(p2 — z)l. 


The loop transmission of a system has two poles at s = —1 and a zero at s = —2. 
There is a third real-axis pole located somewhere to the left of the zero. Several 
different root loci are possible, depending upon the exact location of the third pole. 
The extreme cases occur when the pole is located at infinity or when it is located at 
s = —2. Sketch several different possible loci. 
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FIGURE 4.43 


FIGURE 4.44 


4.12 


Sketch the root locus with respect to a for the system shown in Fig. 4.43. Sketch the 
step responses for a = 0,0.5, 2. 


Section 4.3 


4.13 


4.14 


4.15 


4.16 
4.17 


Consider the system with 


K [(s +1)? + 1] 


ROS) — Gis Fas + 3 


We wish to investigate the root locus versus K. 


a) Plot the location of poles and zeros of G(s) showing the segment of the root locus 
on the real axis. 

b) What are the arrival angles at the complex zeros? 

c) What is the breakaway point? 

d) What are the asymptotes? 

e) Sketch the root locus. 


Draw the root locus for the system with 


Ks + 2) 


CW) = Fis — hie + 8H] 


and verify the imaginary-axis crossings using Routh’s array. 


Using root-locus techniques, determine the values of a < 0 for which the polynomial 
3 2 — 
$^ + 25^ +a = O has repeated roots. 


Sketch the root locus for the system G(s) = K/[(s + 1)(s + 2)(s*+ 4s + 8)]. 
Sketch the root locus for the system 


—8K 
(s — 1)[(s + 2)? +3] 


KG(s) = 
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FIGURE 4.45 


4.18 A simplified model of the longitudinal motion of a helicopter near hover has the 
transfer function 
G(s) = 9.8(s — 0.25 + j2.4975) 
— (s + 0.6565)(s — 0.1183 + j0.3678) 


Sketch the root locus for this system. 


4.19 Let 
l sta 
= ——— d D(s) = K à 
vun T E EGRE. TTE 
Using root-locus techniques, determine zero and pole locations of the compensator (a 
and b) that will produce closed-loop poles at s = —1 + 1j for the system shown in 
Fig. 4.44. 


4.20 Use asymptotes, center of asymptotes, angles of departure and arrival, and Routh's 
array to sketch root loci for the following feedback control systems (Fig. 4.45) for 


EK. 29 [E 

AOp TERI PEE HG) = Ivy 
b) Gs) = TAS HG) 

à G(s) = Ais 3 + 47s +3 — 4901 H(s) = 1. 


s((s -1-2jYs-c-1-2j)' 
4.21 Consider the system in Fig. 4.46. 


a) Using the Routh criterion, determine all values of K for which the system is stable. 
b) Sketch the root locus (include angles of departure and arrival and K and s values 
at breakpoints and crossings of the imaginary axis). 


FIGURE 4.46 "T E 
r o—+)— k I— 


s+3 
s(s?+4s+5) 
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Ls 


FIGURE 4.47 + 


ro— J 


(s+2)\(s—1)(s—2) 


(a) 


|| 8-2 
(s+2)\(s—1) 


4.22 Consider the two systems given in Fig. 4.47. Note that each system has an unstable 
plant and the same loop transfer function. Can either system be made stable for some 
positive value of K? Show your reasoning, using a root-locus diagram. 


4.23 Using the root locus, find the range of gain K for which the systems in Fig. 4.48 are 
stable. 


FIGURE 4.48 


s?+s+2 
s(s+5)(s+6)(s?+2s+1) 


(a) 


s+2 
s(s—2)(s?+2s+10) 


(b) 


FIGURE 4.49 


FIGURE 4.50 
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1 
s(s+1)(s+0.5) 


4.24 Consider the root-locus problem where 


(s? + s +9.25)(s + 2) 


C) = G+ DG + 2065? + s + 1625] 


a) Sketch the portions of the real axis corresponding to the positive root locus. 

b) Sketch the asymptotes for K — œ and give the angles of the asymptotes and 
crossing with the real axis. 

c) Estimate the departure angle at the pole at s = —(1/2) + j4. 

d) Estimate the arrival angle at the zero at s = —(1/2) + j3. 

e) Give the polynomial whose roots include all points of multiple roots such as break- 
in and breakaway points. 

f) Sketch the root locus. 


4.25 Consider the system in Fig. 4.49. 


a) Use Routh's criterion to determine regions in the (Kı, K2) plane such that the 
system remains stable. 
b) Use root locus to verify the results in (a). 


4.26 An elementary magnetic suspension scheme is sketched in Fig. 4.50. For small mo- 
tions near the reference position, the voltage e is proportional to ball displacement x 
(in meters) such that e — 100x. The upward force (in newtons) on the ball caused 
by the current i (in amperes) may be approximated by f = 0.5i + 20x. The mass 


Vo 


Solenoid 


Photo 
detector 
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FIGURE 4.51 


of the ball is 20 g, and the gravity force is 9.8 N/kg. The power amplifier is a 
voltage-to-current device so that 7 = u + Vo in amperes. 


a) Write the equations of motion for this setup. 

b) Give the value of bias Vo so that the ball is in equilibrium at x 

c) What is the transfer function from u to e? 

d) Sketch the root locus of the closed loop as a function of K if u = —Ke. 

e) Suggest a different control law (transfer function from e to u) to give improved 
control over that shown in (d). 


0. 


Section 4.4 


4.27 


4.28 


4.29 


Sketch the root locus for the system 


K(s + 1) 


90) 7 ss * DG € 2 


and determine the value of the root-locus gain such that the complex conjugate poles 
have a damping ratio of 0.5. 


For the system in Fig. 4.51: 


a) Find the locus of closed-loop roots versus K. 

b) Is there a value of K that will cause all roots to have a damping ratio greater than 
0.5? 

c) Assuming the locus goes through a point where the damping ratio ¢ = 0.707, find 
the values of K that result in these roots. 


Consider the rocket-positioning system shown in Fig. 4.52. First show that lead com- 
pensation 


s+2 


H — —K 
(s) s+4 


stabilizes the system with a perfect measurement of x. Then assume that there is a 
sensor that measures x and that it is modeled as a single pole with a 1/10-s time 
constant (and unity DC gain). Using the root-locus procedure, find K that will provide 
maximum damping ratio. 
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FIGURE 4.52 


Sensor 


K(s+2) 
s+4 


4.30 A unity feedback system has the plant transfer function 


K 


EMI ES Sia Br BD 


We wish to investigate the root locus versus K. 


a) Plot the location of poles and zeros of G(s) showing segments of the root locus 

~ on the real axis. 

b) What are the departure angles from the complex poles? 

c) Where are the breakaway and break-in points? 

d) Sketch the root locus. 

e) What is the value of K at the point where the closed-loop complex roots have 
damping ratio = 0.5? 


4.31 For the system in Fig. 4.53: 


a) Sketch the locus of closed-loop roots versus K. 
b) Find the maximum value of K at which the system is stable. (Assume that the 
locus crosses the imaginary axis at s = + 5.5.) 


FIGURE 4.53 


100 
(s+6+2j)(s+6—2)7) 
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Assume K = 2 for the remaining parts of this problem. 


c) What is the steady-state error (e = r — y) for a step in 7? 

d) What is the steady-state error in y for a constant disturbance w? 

e) What is the steady-state error in y for a constant disturbance w 7? 

f) If you wished to have more damping, what changes would you make in the 
system? 


4.32 Consider the positioning servomechanism system shown Fig. 4.54, where 


ei = Kobi, eo = Kpa0o0, and Kpo = 10 V/rad; 
Motor torque T = k,i,; 


km = 0.1 N: m/A; 
Ra = l0Q (armature resistance); 
Gear ratio = 1: 1; 
Ji, + Jm = 10 ^?kg - m?(total inertia); 
C = 200uf; 


Va = Kale; — ey). 


a) What is the range of the gain K4 for which the system is stable? Calculate the 
upper limit graphically from your root locus. 

b) Choose a gain K4 that gives roots at ¢ = 0.7. Where are all three closed-loop root 
locations? 


FIGURE 4.54 

(Reprinted from Clark, 1962, with permission.) 
Input Output 
potentiometer potentiometer 


8o 


E; [4 X. SN E, 


Feedback filter 


FIGURE 4.55 
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Section 4.5 


4.33 We wish to design a velocity control for a tape-drive servo. The transfer function from 


current to velocity (in millimeters per millisecond per ampere) is 


V(s) _ _15(s? + 0.95 + 0.8) 
I(s) (s +1)(s?2 + 1.ls +1) 


We wish to design a feedback system so that the result is Type I and the transient 
satisfies 


t, = 4 ms, t, 15 mis, and M, = 0.05. 


a) Assume a compensation K/s to achieve Type I behavior, and sketch the root locus 
versus K. Show on the same plot the region of acceptable pole locations corre- 
sponding to the specifications. 

b) Assume compensation of the form K(s + @)/s and select the best possible values 
of K and a you can find. Sketch the root-locus plot of your design, giving values 
for K and a and the velocity constant K , achieved. Indicate the closed-loop poles 
with A and include the boundary of the region of acceptable root locations. 


4.34 Consider the Type I system in Fig. 4.55. We would like to design the compensation 


D(s) to meet the following requirements: (1) Steady-state error in y due to a constant 
unit disturbance w should be less than 4/5, and (2) damping ratio ¢ equals 0.7. Using 
root-locus techniques: 


a) Show that proportional control alone is not adequate. 
b) Show that proportional-plus-derivative control will work. 
c) For D(s) = K + Kıs, find gains K and Kg to meet the design specifications. 


4.35 Consider the 270 ft. United States Coast Guard WMEC Tampa (WMEC 902) shown 


in Fig. 4.56. Parameter identification based on sea trials data (Trankle, 1987) was 
used to estimate the hydrodynamic coefficients in the equations of motion. The result 
is that the system may be described by the second-order transfer functions: 


v |  0.2196(s + .0019) 

8 — (s--0.2647)(s + 0.0063) 
r | —0.0184(s + 0.0068) 
8 — (s--0.2647)(s + 0.0063) 
ro 0.0000064 

w — (s--0.2647Y(s + 0.0063) ’ 


ea 
s(s+1) 
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FIGURE 4.56 
USCGC Tampa (WMEC 902) 


a 
HERD 


Jet HATTE ES ET TS 


i 1. a. Fa 
0 10 20 30° 40 50 


4.36 


where 


v = lateral velocity (m/sec), 
r = yaw rate (rad/sec), 

6 = rudder angle (rad), 
Ww 


= wind (m/sec) 


a) Determine the open loop settling time of the system for both v and r. 
b) In order to regulate the heading angle v, where 


ber, 


design a compensator using the measurement provided by a yaw rate gyro (i.e., r). 
The settling time is specified to be less than fifty seconds. Design a compensator 
to get a steady-state heading angle error of less than 0.5 degree for wind gusts of 
10m/sec. 

c) For a five degree change in heading, the maximum allowable rudder angle deflec- 
tion is specified to be less than ten degrees. Repeat (b) with this requirement. 


Golden Nugget Airlines has opened a free bar in the tail of each of their airplanes in an 
attempt to lure customers. In order to adjust automatically for the sudden weight shift 
due to passengers rushing to the bar when it first opens, the airline is mechanizing 
a pitch-attitude autopilot. The block diagram of the proposed arrangement is seen in 
Fig. 4.57. We assume a step function for the passenger moment M p(s) = Mo/s and 
a maximum expected value for Mo of 0.6. 


FIGURE 4.57 
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a) 


e) 
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Aircraft 
dynamics 


Attitude 
sensor 


What value of K is required to keep the steady-state error in 0 less than 0.02 
rad(~ 1°)? (Assume the system is stable.) 

Draw a root locus versus K. 

Based on your root locus, what is the value of K when the system goes unstable? 
Suppose the value of K required for acceptable steady-state errors is 600. Show 
that this value yields an unstable system with roots at (approximately) 


s = +1 + j6.6, —3, —14. 


You are given a black box with “Rate gyro” written on the side and told that when 
installed it provides a perfect measure of 0, with output K 70. 


(1) Draw a block diagram indicating how you would incorporate this into the 
autopilot (include transfer functions in boxes). 

(2) Sketch a root locus versus Kr (the gain associated with the 0 term). 

(3) What is the maximum damping ratio of the complex roots obtainable with this 
configuration? 

(4) What is the value of Kr for (3)? 


Suppose you aren't satisfied with the steady-state errors and damping ratio of the 
system with a rate gyro. Discuss the advantages and disadvantages of adding an 
integral term and extra lead networks in the control law. Support your comments 
with rough root-locus sketches. 


Consider the instrument servomechanism with parameters as given in Fig. 4.58. For 
each case draw a root locus with respect to the parameter K and indicate the location 
of the roots corresponding to your final design. 


a) 


Lead Network: Let 


G,(s) = 1, G,(s) = K | and 
S+p 


sk p 
Z 
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FIGURE 4.58 


FIGURE 4.59 
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Sensor 


Select z and K so that the roots nearest the origin (the dominant roots) have = 0.4, 
RelA) & —T7, K, = 162. Re(A;) denotes the real part of the pole A;. 


b) Output Velocity (Tachometer) Feedback: Let 


G,(s) = 1+Krs and GAs) = K. 


Select Ky and K so that the dominant roots are in the same location as those of 
case I. Compute K,. Give, if you can, the physical reason explaining the reduction 
in K, when output derivative feedback is used. 


c) Lag Network: Let 


st+1 


G;(s) = 1 and G,(s) = K : 
Ss +p 


When we use proportional control, we obtain a K, = 12 at ¢ = 0.4. Select K and 
p so that the dominant roots correspond to the proportional control case but with 
a K, of 100 rather than 12. 


Section 4.6 
4.38 For the third-order system shown in Fig. 4.59, 


a) Sketch the locus of the closed-loop system pole locations versus the parameter K 
using Evans’ methods. Show your calculations for sketching (angle of asymptotes, 
departure angles, etc.). 

b) Using graphical techniques, locate carefully the point at which the locus crosses 
the imaginary axis. What is the value of K at that point? 


FIGURE 4.60 


FIGURE 4.61 
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c) Assume that (due to some unknown mechanism) the amplifier output is a function 
of the magnitude of e. Specifically, let the control be 


u=e for lel 1; 
u= 1 fore >1; 
u= =] lote < —1 


Qualitatively describe how you would expect the system to respond to a unit step 
input. 


4.39 A block diagram of a position servomechanism is shown in Fig. 4.60. 


a) Sketch the root locus versus K for Kr (tachometer feedback) = 0. 

b) Indicate on the locus of (a) the root locations corresponding to K = 4. For these 
locations, estimate the transient-response parameters t,, Mp, and ts. 

c) For K = 4, draw the root locus versus Kr. 

d) For K = 4 and Kr set so that M, = 0.05 (¢ = 0.707), estimate t, and r ,. 

e) For the parameters of (d), what is the velocity constant K , of this system? 


4.40 Consider the mechanical system shown in Fig. 4.61 where g and a are gains. The 


feedback path containing gs controls the amount of rate feedback. For a fixed value 
of ao, adjusting g corresponds to varying the location of a zero in the s plane. 


a) For g = O, find a value for ao such that the poles are complex. Hint: Let ao = 1, 
T — ]. 

b) Fix do at this value and construct root loci that demonstrate the effect of vary- 
ing g. 
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FIGURE 4.62 


4.41 
4.42 
4.43 


4.44 


4.45 


Sketch the 0? (negative) root locus for the systems in Problem 4.2 versus K. 
Sketch the 0? root locus for systems in Problem 4.4 versus K. 


State and prove an expression for the angles of the asymptotes of the negative (0^) 
root locus. 


Sketch the root locus for the system in Fig. 4.62 versus K. What is the range of K for 
which the system is unstable? 


Prove that the plant G(s) = l/s? cannot be made unconditionally stable if pole 
cancellation is forbidden. 


9.1 


The Frequency- 
Response Design 


Method 


Introduction 


The design of feedback control systems in industry is probably accomplished using 
frequency-response methods more often than any other method. The popularity of 
these methods with practicing engineers has remained high over the years despite 
the development of alternate design methods, such as root locus, state-space, and 
optimal control. The primary reason for the popularity of frequency-response design 
is that it provides good designs in the face of uncertainty in the plant model. 
For example, systems with poorly known or changing high-frequency resonances 
can have their feedback compensation tempered to alleviate the effects of those 
uncertainties. Currently this tempering is carried out more easily using frequency- 
response design rather than any other method. 

For complex systems with more than one input or output, frequency-response 
methods have been extended (called H” design) to aid in design and especially 
to establish measures of sensitivity to plant uncertainties. The study of frequency- 
response design for the single-input, single-output systems that is the subject of 
this book is important for later understanding of more advanced topics. 
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9.2 


Another advantage of using frequency response is the ease with which exper- 
imental information can be used for design purposes. Raw measurements of the 
output amplitude and phase of a plant undergoing a sinusoidal input are sufficient 
to design a suitable feedback control. No intermediate processing of the data to 
arrive at the system model (poles and zeros or system matrices) is required. The 
wide availability of computers has rendered this advantage less important now than 
it was years ago; however, for relatively simple systems, frequency response is 
often still the most cost-effective design method. 

A disadvantage of the method is that the underlying theory is rather compli- 
cated and requires a rather broad knowledge of complex variables. However, the 
methodology of design is easy, and the insights gained by learning the theory are 
well worth the struggle. 


Frequency Response 


In this section we will describe how a system responds to sinusoidal input— called 
the system's frequency response —and how this response can be obtained from a 
knowledge of its pole and zero locations. 

To introduce the ideas, consider a system described by 


Y(s) 
U(s) 


— G(s) 


where the input u(t) is a sine wave with an amplitude of Uo, that is, 
u(t) = U,sinot, 
which has a Laplace transform 
U,o 
U = ——. 
(s) s? + w? 


The Laplace transform of the output is 
U,w 
F(s) = Gis). 
m 80) 
A partial fraction expansion of the preceding will result in an equation with the 
form 


a a? Qn Qo a% 


Y(s) = (5.1) 


| ide T - ^ 
$ tT ay $ + a2 $t d, S T Jo s= j®@ 


where a1,a2,..., a, are the poles of G(s), where a, would be found by perform- 


FIGURE 5.1 
Response of G(s) = 
l/(s + 1) to sin(10r). 
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ing the partial fraction expansion as outlined in Problem 5.1, and œ% is the complex 
conjugate of a,. The time response that corresponds to Y(s) is 


y(t) = ae *" +ane +... t ae *" + 2\a,|sin(wt + $) (5.2) 


where @ = tan ! Re(a,)/Im(a,). If all the poles of the system represent stable be- 
havior (a;1,a2, ..., à, = 0), the natural, unforced response will die out eventually 
and therefore the steady-state response of the system is due solely to the sinusoidal 
term in Eq. (5.2) caused by the sinusoidal excitation. For example, Fig. 5.1 shows 
the response of the system, G(s) = l/(s + 1), to the input, u = sin(10r). It shows 
how the natural part of the response associated with the G(s), that is, the e '' por- 
tion, disappears after several time constants and so the pure sinusoidal response 
is all that remains. Problem 5.1 shows that the remaining sinusoidal term in Eq. 
(5.2) can be expressed as 


y(t) = U,Asin(ot + $) (5.3) 
where 
ee asa IMG) o, 
A = |G(jo)| = |G(s)| - and œ = tan Re(Gja)) > ZG( jo). 
(5.4) 


Equation (5.3) shows that a stable system with transfer function G(s) excited 
by a sinusoid with unit amplitude and frequency œw will, in steady-state, exhibit a 


Mah EE 
TU 
LEITET LTLULI 
ORAE 
"AAAA 


5 10 
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sinusoidal output with magnitude A(w) and phase (w) at frequency w. The fact 
that the output y is a sinusoid with the same frequency as the input u and that 
the magnitude A and phase ¢@ of the output are independent of the amplitude U, 
of the input are consequences of G(s) being a linear continuous system. If the 
system being excited were a nonlinear or discrete system, the output might contain 
frequencies other than the input frequency, and the output magnitude might be 
dependent on the input magnitude. 

The magnitude A is given by |G(j@)| and the phase $, is given by 2G(jw); 
that is, the magnitude and angle of the complex quantity G(s) evaluated with s 
taking on values along the imaginary axis. We are not only interested in analyzing 
the frequency response of a system in order to understand how it responds to a 
sinusoidal input, but also because evaluating G(s) with s taking on values along 
the jw axis will prove to be very useful in the determination of stability of a 
closed-loop system. The jw axis is the boundary between stability and instability 
and we will see in Section 5.5 that the evaluation of G(j«) provides information 
that allows a closed-loop stability determination from the open loop G(s). 

As an example of frequency response, consider the capacitor described by the 
equation 


where the input is v and the output is 7. The transfer function of this circuit is 
G(s) = Cs, 
and 
G(jo) = C jo. (5.5) 
Computing the magnitude and phase, we find that 
A= |Cjo| = C» and $ = Z(Cjo) = 90°. (5.6) 


For a unit amplitude sinusoidal input v, the output ; will be a sinusoid with mag- 
nitude A and will lead the input by 90?. Note for this example that the magni- 
tude is proportional to the input frequency while the phase is independent of fre- 
quency. 

In the cases where a designer does not have a good model of the system and 
wishes to determine the frequency-response magnitude and phase experimentally, 
the system is excited by a sinusoid with varying frequency. The magnitude A(w) 
is obtained by a measurement of the ratio, output sinusoid to input sinusoid, in the 
steady state at each frequency. The phase (w) is the measured difference in phase 
between input and output signals. Hewlett-Packard produces an instrument (Model 
no. 3563A) that automates this experimental procedure and greatly speeds up the 
process. 
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A great deal more can be learned about the dynamic response of a system from 
knowledge of the magnitude A(w) and the phase (w) of its transfer function. In 
the obvious case, if the signal is a sinusoid, then A and @ completely describe 
the response. Furthermore, if the input is periodic, then a Fourier series can be 
constructed to decompose the input into a sum of sinusoids, and again A(w) and 
p(w) can be used with each component to construct the total response. For transient 
inputs, our best path to understanding the meaning of A and d is to relate the 
frequency response G(jw) to the transient responses calculated by the Laplace 
transform. For example, in Fig. 2.35 we have plotted the step response of a system 
having the transfer function 


l 


Gs) = Fn XE.) 1 


(3.7) 


for various values of ¢. To compare, we should plot A(w) and (w) for these same 
values of Z and see which features of frequency response correspond to the transient 
characteristics. In order to make the comparisons effective, we need to consider 
an efficient and meaningful form in which to make frequency-response plots. 


5.2.1 Bode Plot Techniques 


Display of frequency response is a problem that has been studied for a long time, 
and the most useful technique for our purposes was developed by H. W. Bode 
at Bell Laboratories between 1932 and 1942. This technique allows a plotting by 
hand that is quick and yet sufficiently accurate for control-system design. Most 
control-system designers will have access to computer programs that will diminish 
the need for hand plotting; however, it is still important to develop good intuition 
so that erroneous computer results are quickly identified, and for this one needs 
the ability to check results by hand. 

The first idea is to plot magnitude curves using a logarithm scale and phase 
curves using a linear scale. This allows the plotting of a high-order G( jw) by 
simple graphical addition of the separate terms, as discussed in Appendix B. 
This follows because a complex expression with zero and pole factors can be 
written as 

$1 $2 » r ,e/791r, 079 7 [un s i(0\+62—6s) 
F3 


(5.8) 


Equation (5.8) shows that the phases of the individual terms are added directly to 
obtain the phase of the composite expression. Furthermore, since 


i POUT 
IG(je)| = —, 
r3 
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then 
logio |G(j@)| = logio ri + logio r2 — logio r3, (5.9) 


and we see that addition of the logs of the individual terms provides the log of 
the magnitude of the composite expression. The frequency response is typically 
present as two curves, a plot of logarithm of magnitude versus log w and a plot of 
the phase versus log w. This is called a Bode plot of the system. Since 


logio Ae/? = log, A + J logy e, (5.10) 


the Bode plot is seen to be essentially the real and imaginary parts of the logarithm 
of G(jw). In communications it is standard to measure power gain in decibels.* 


Pj 
Glag = 101 =, 
[Gla 0810 Pi 
Since power is the square of the voltage, the voltage gain is 
V 
Glas = 2010810 7. 
l 


Hence one can present a Bode plot giving the magnitude in decibels versus log w 
and the phase in degrees versus log «.' In this book, we will present a Bode plot 
as log |G| versus log « and also mark an axis in decibels on the right-hand side of 
the magnitude plot in order to give the reader a choice in working with whichever 
representation is preferred. If the magnitude plot is carried out using log |G|, it 
is common to plot on a log scale and mark the scale in terms of |G| magnitude 
directly. If the plot is carried out using decibels, the vertical scale will be a linear 
one with each decade of |G| magnitude representing 20 decibels. An example of 
Bode plots of magnitude and phase will be seen later. 

Advantages of working with frequency response in terms of Bode plots include: 


1. Bode plots of systems in series simply add. 
2. Bode's phase-gain relationship is in terms of logarithms of phase and gain. 


3. A much wider range of the system's behavior can be displayed; that is, both 
low- and high-frequency behavior can be displayed in one plot. 
4. Bode plots can be determined experimentally. 


5. Compensator design can be based entirely on Bode plots. 


In Chapter 4, we always wrote the open-loop transfer function in the form 


or rapis F 25)... 
KG = K < 5 tI 
V) AT ROSE ml. uH 


* Researchers for the telephone company first defined the unit of power gain as a “bel.” However, this 
unit proved to be too large, and hence a decibel (i.e., one-tenth of a bel) was selected as the unit, 
which is, of course, named after Alexander Graham Bell. 


* Henceforth we will drop the base of the logarithm; it is understood to be 10. 
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because this was the most convenient way to determine the degree of stability 
from the root locus versus the gain K. In working with frequency response, it 
is most convenient to replace s with j« and to write the transfer functions in the 
"Bode" form 


(Jor; +1Xjøn + 1)... 


(0) (jor, + (jor + D... 


(3.12) 
because the gain K in this form is directly related to the transfer function magnitude 
at very low frequencies. In fact, for type I systems, the K in Eq. (5.12) is equal to 
A at w = 0, and is also equal to the DC gain of the system. Note that if a transfer 
function is given in the form of Eq. (5.11), it is a straightforward calculation to 
arrive at an equivalent transfer function in the form of Eq. (5.12); however, note 
that the gain K will not have the same value in the two expressions. 

As an example of rewriting a transfer function according to Eqs. (5.8) and 
(5.9), suppose 


Katie) c Ko ET S (5.13) 
w) = ——— ÓÀà s 
j (jo)(jot + 1) 
Then 

LKG(jo) = ZK + Z(jon + 1) - Zo? — Z(jeor, +1), 614 
and 


log |KG(jw)| = log|K| + log| jør + 1| — log (jæ)?| — log| jar, + 1 


or in decibels, 
IKG(jo)|las = 20log|K| + 20log|jw7 + 1| — 20 log |(jc)?| 
— 20 log | jw, + 1|. 
All transfer functions for the kinds of systems we've talked about so far are 
composed of three classes of terms: 
1. K(jo)", 
2. (jor  1)*!, 


3. ( = 
Wn 
First we'll discuss the plotting of each individual term and how the terms affect 


the composite plot including all the terms; then we’ll discuss how the composite 
curve can be drawn. 


E] 


2 : 
eap a 
Wp 


1. K(jo)" Since 
log K|\(jw)"| = logK + nlog| ja, 
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FIGURE 5.2 
Magnitude of (jw)". 
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|(jw)”| 


Slope is +1, or 20 dB/decade 


Decibels 


0.1 100 1000 W, rad /s 


the magnitude plot of this term is a straight line with a slope of n. Some 
examples are shown in Fig. 5.2. This term is the only one that affects the 
slope at the lowest frequencies because all other terms are constant in that 
region. The easiest way to draw the curve is to locate w = 1 and plot log K 
at that frequency. Then draw the line with slope n through that point.* The 
phase of (jw) is n X 90°; it is independent of frequency and thus a horizontal 
line: —90? for n = —1; —180° for n = —2; +90° for n = +1; and so on. 
jor 1 The magnitude of this term approaches one asymptote at very 
low frequencies and another asymptote at very high frequencies: 


a) For or <1, jor - 12e 1. 
b) For wr È 1, jor - 1 = jor. 


If we call o = 1/7 the breakpoint, then we see that at frequencies below the 
breakpoint, the magnitude curve is approximately constant (— 1), while above 
the breakpoint, the magnitude curve behaves similarly to K(jw)”", the term 
just described as class 1. The example plotted in Fig. 5.3, G(s) = 10s + 1, 
shows how the two asymptotes cross at the breakpoint and how the actual 
magnitude curve is a factor of 1.4, or 3 dB above that crossing point (or a 
factor of 0.707, or 3 dB below if the term is in the denominator). Note that this 
term will have only a small effect on the composite magnitude curve below 
the breakpoint because its value is equal to 1 (= 0 dB) in this region. 


M IR 


decibel units, the slopes are n X 20 dB per decade or n X 6 dB per octave. (An octave is a change 


in frequency by a factor of 2.) 
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FIGURE 5.3 
Magnitude plot for Breakpoint G(s)=10s+1 
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The phase curve can also be drawn easily by using the low- and high-frequency 
asymptotes: 
a) For or « 1, Z1 = 0°. 
b) For wrt > 1, Zjwr = 90°. 
c) For wt = 1, Z(jwr + 1) = 45°. 
For wr = 1, the 2(jw + 1) curve is tangent to an asymptote going from 0° at 
wT = 0.2 to 90° at wr = 5, as shown in Fig. 5.4. The figure also illustrates 
the three asymptotes (shown dashed) used for the phase plot and how the 
actual curve deviates from the asymptotes by 11° at their intersections. Both 
the composite phase and magnitude curves are unaffected by this class of term 
at frequencies a factor of 10 or so below the breakpoint because its magnitude 
is 0 dB and phase is 0°. 
FIGURE 5.4 
Phase plot for jw7 + 1. Breakpoint i 
- 
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re 
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This term behaves in a manner similar to the term above. The differences are 
that the magnitude changes slope by +2 or +40 dB per decade (—2 or —40 dB 
per decade if the term is in the denominator) at the breakpoint, the breakpoint 
being at w = w,; the phase changes by +180°; and the transition through 
the breakpoint region varies with the damping ratio Z. Figure 5.5 shows the 
magnitude and phase for several different damping ratios, assuming the term is 
in the denominator. Note that the magnitude asymptote for frequencies above 
the breakpoint has a slope of —2 or —40 dB per decade and that the transition 
through the breakpoint region has a large dependence on the damping ratio. A 
rough sketch of this transition can be made by noting that 


l 
IGCjo)| = 7; at w = 0, 
for this class of second-order term in the denominator. If the term is in the 
numerator, the magnitude would be the reciprocal of the curve plotted in 
Fig. 5.5(a). 

No such handy rule exists for sketching the transition for the phase curve; 
therefore one would have to resort to Fig. 5.5(b) for an accurate plot of the 
phase. However, a very rough idea of the transition can be gained by noting that 
the transition is a step for 4 = 0, while it obeys the rule for two first-order 


terms, (i.e., the class 2 terms just described) when ¢ = 1 with simultane- 
ous break frequencies. All intermediate values of Z fall between these two 
extremes. 


We can now compare the frequency-response curves of Fig. 5.5 with the 
transient-response curves of Fig. 2.41. The transient curves are normalized with 
respect to time as w,,f. From the frequency response, we see that w, is the break 
frequency and is approximately the bandwidth —the place where the gain starts to 
fall off from its low-frequency value. Therefore the rise time can be estimated from 
the bandwidth. We also see that the peak overshoot in frequency is approximately 
1/2¢ for £ < 0.5, so the peak overshoot in step response can be estimated from 
the peak overshoot in frequency response. Thus we see that essentially the same 
information is contained in the frequency-response curve as is found in the transient 
responses. 

When the system has several poles and several zeros, plotting the frequency 
response requires that the components be combined into a composite curve. To plot 
the composite magnitude curve, it is useful to note that the slope of the asymptotes 
is equal to the sum of the slopes of the individual curves. Therefore the com- 
posite asymptote curve has integer slope changes at each break frequency: +1 for 


FIGURE 5.5 

(a) Magnitude and 
(b) phase of 
W{(jw/w,) + 

2¢ (jw/w,) + 1]. 
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is 


a first-order term in the numerator, —1 for a first-order term in the denominator, 
and +2 for second-order terms. Furthermore, the lowest-frequency portion of the 
asymptote has a slope determined by the value of n in the (j«)" term and is 
located by plotting the point Kw” at w = 1. Therefore the complete procedure 
consists of plotting the lowest-frequency portion of the asymptote, then sequentially 
changing the asymptote's slope at each breakpoint in order of ascending frequency, 
and finally drawing the actual curve by using the transition rules discussed with 
classes 2 and 3. 

The composite phase curve is the sum of the individual curves. The graphical 
addition of the individual phase curves is facilitated by locating the curves so that 
the composite phase approaches the individual curve as closely as possible. A 
quick but crude sketch of the composite phase can be found by starting the phase 
curve below the lowest breakpoint and setting it equal to n X 90°. The phase is 
then stepped at each breakpoint in order of ascending frequency. The amount of 
the phase step is +90° for a first-order term and +180° for a second-order term. 
Breakpoints in the numerator indicate a positive step in phase while breakpoints in 
the denominator indicate a negative phase step.* 


Summary of Bode Plot Rules 


STEP 1: Manipulate the transfer function into the form given by Eq. (5.12). 


STEP 2: Determine the value of n for the K(jw)” class of term. Plot the low- 
frequency magnitude asymptote through the point K at w = 1 with a slope of n 
(or n X 20 dB per decade). 


STEP 3: Complete the composite magnitude asymptotes by extending the low- 
frequency asymptote until the first frequency breakpoint, then stepping the slope 
by +1 or +2, depending on whether the breakpoint is from a first- or second-order 
term in the numerator or denominator, and continuing through all breakpoints in 
ascending order. 


STEP 4: Sketch in the approximate magnitude curve by increasing from the asymp- 
tote by a factor of 1.4 (+3 dB) at first-order numerator breaks and decreasing it 
by a factor of 0.707 (—3 dB) at first-order denominator breaks. At second-order 
breakpoints, sketch in the resonant peak (or valley) according to Fig. 5.5(a) using 
the relation that |G(j@)| = 1/(2¢) at the break. 


STEP 5: Plot the low-frequency asymptote of the phase curve, @ = n x 90°. 


*This approximate method was pointed out to us by our Parisian friends. 


EXAMPLE 5.1 
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STEP 6: As a guide, sketch in the approximate phase curve by changing the phase 
by +90° or +180° at each breakpoint in ascending order. For first-order terms in 
the numerator, the change of phase is +90°; in the denominator, the change is 
—90°. For second-order terms, the change is +180°. 


STEP 7: Locate the asymptotes for each individual phase curve so that their phase 
change corresponds to the steps in the phase from the approximate curve indicated 
by step 6. Sketch in each individual phase curve as indicated by Fig. 5.4 or 
Fig. 5.5(b). 


STEP 8: Graphically add each phase curve. Use dividers if an accuracy of about 
+5° is desired. If lesser accuracy is acceptable, the composite curve can be done 
by eye, keeping in mind that the curve will start at the lowest-frequency asymptote 
and end on the highest-frequency asymptote, and will approach the intermediate 
asymptotes to an extent that is determined by the proximity of the breakpoints to 
each other. 


As an example of Bode plotting, suppose we wish to plot the magnitude and 
phase of 
2000(s + 0.5) 


G(s) = s[(s + 10) + 50)] E (5.15) 


STEP 1: Convert to the form in Eq. (5.12). This yields 


2[(j@/0.5) + 1] 


SOO ME IIS EE 


(5.16) 
STEP 2: The term in jo is first order and in the denominator; hence n = - 1. 
Therefore, the low-frequency asymptote (valid for œw < 0.5 because the lowest 
breakpoint is at w = 0.5) is defined by the first term: 


Gay =, (5.17) 
jo 


The magnitude plot of this term has the slope of —1 or —20 dB per decade and is 
located by passing the line through the value 2 atw = 1 even though the composite 
curve will not go through the point because of the breakpoint at «o = 0.5. This is 
shown in Fig. 5.6(a). 


STEP 3: The remainder of the asymptotes, also shown in Fig. 5.6(a), were obtained 
by next drawing a line with O slope that intersects the original — 1 slope atw = 0.5; 
then drawing a — 1 slope line that intersects the previous one at w = 10; and finally 
drawing a —2 slope line that intersects the previous —1 slope at w = 50. 


STEP 4: The actual curve is then sketched in to be approximately tangent to the 
asymptotes when far away from the breakpoints, a factor of 1.4 above (+3 dB) 


FIGURE 5.6 
Composite plots: 


(a) magnitude, (b) phase, 


and (c) approximate 
phase. 
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the asymptote at the w = 0.5 breakpoint, and a factor of 0.7 down (—3 dB) from 
the asymptote at the w = 10 and w = 50 breakpoints. 


STEP 5: Since the phase of Eq. (5.17) is —90°, the phase curve in Fig. 5.6(b) 
starts at —90° at the lowest frequencies. 


STEP 6: The result is shown in Fig. 5.6(c). 


STEP 7: The individual phase curves, shown dashed in Fig 5.6(b), have the correct 
phase change for each term and are located vertically so that their phase change 
corresponds to the steps in the phase from the approximate curve in Fig. 5.6(c). 
Note that the composite curve approaches each individual term. 


STEP 8: The graphical addition of each dotted curve results in the solid composite 
curve in Fig. 5.6(b). As can be seen from the figure, the vertical placement of 
each individual phase curve makes the required graphical addition particularly easy 
because the composite curve approaches each individual phase curve in turn. p 


As a second example, we show the Bode plots for a system with second-order 
terms. An example like this is more difficult to plot than the previous exam- 
ple because the transition between asymptotes is dependent on the damping ratio; 
however, the same basic ideas previously illustrated apply. The transfer function rep- 
resents a mechanical system with two equal masses coupled with a lightly damped 
spring. The applied force and position measurements are collocated on the same 
mass. For the transfer function, the time scale has been chosen so that the resonant 
frequency of the complex zeros is equal to 1. The transfer function is 


0.01(5^ - 0.015 + 1) 
G(s) =~ “Ale 974. Lik Wo, 1 11* 
s^[(s^/4) + 0.02(s/2) + 1] 

Proceeding through the steps, we start with the low-frequency asymptote, 
0.01/w*. It has a slope of —2 (—40 dB per decade) and passes through magnitude = 
0.01 atw = 1 as shown in Fig. 5.7(a). At the break frequency of the zero, w = 1, 
the slope shifts to zero (break up by 2) until the break of the pole is located at 
w = 2, when the slope again breaks down to a slope of —2. To interpolate the 
true curve, we plot the point at the zero breakpoint, o = 1, with a magnitude 
ratio below the asymptote of 2¢ = 0.01. At the pole breakpoint, the magnitude 
ratio above the asymptote is 1/(2¢) = 1/0.02 = 50. The magnitude curve is a 
“doublet” of a negative pulse followed by a positive pulse. The phase curve for 
this case starts at — 180° corresponding to the 1/s? term, jumps +180° to $ = 0 
atw = ] due to the zeros and falls 180° back to @ = —180° at w = 2 due 
to the poles as shown in Fig. 5.7(b). With such small damping ratios, the square- 
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wave approximation is quite good as suggested by Fig. 5.5(b). The true composite 
phase curve is nearly a square pulse between w = 1 and w = 2, as shown in 
Fig. 5.7(b). i: 


5.2.2 Steady-State Errors 


We saw in Section 3.3 that the steady-state error of a feedback system decreases 
as the gain of the open-loop transfer function increases. In plotting a composite 
magnitude curve, we saw in the previous section that the low-frequency asymptote 
is given by 


KG(jo) = K(joy. (5.18) 


Therefore, one can conclude that the larger the value of the magnitude on the low- 
frequency asymptote, the lower the steady-state errors will be for the closed-loop 
system. This idea is very useful in the design of compensation where we often want 
to evaluate several alternate ways to improve stability. It is also useful in being able 
to quickly see the effects of changes in the compensation on the steady-state errors. 

For a system of the form given by Eq. (5.12), that is, where n = O in Eq. 
(5.18) and often referred to as a type 0 system, the low-frequency asymptote is 
a constant and the gain K of the open-loop system is equal to the position error 
constant, K,. For a unity feedback system with a unit step input, Table 3.3 shows 
that the steady-state error is 


l 
1+K, 


ca = 


For a system where n = -—1 in Eq. (5.18), often referred to as a type I 
system, the low-frequency asymptote has a slope of —1. The magnitude of the low- 
frequency asymptote is related to the gain according to Eq. (5.18) and, therefore, 
we can again read the gain K directly from the Bode magnitude plot. Section 3.3 
shows that the velocity error coefficient K, is equal to the gain K in Eq. (5.18) 
for this case. For a unity feedback system with a unit ramp input, the steady-state 
error is then found from 


The easiest way of determining the value of K, in a type I system is to read 
the magnitude of the low-frequency asymptote at o = 1 rad/s because K, = K 
at this frequency. In some cases, the lowest-frequency breakpoint will be below 
w = | rad/s, therefore the asymptote can be extended to w = 1 rad/s in order to 
read K, directly. Alternately, the magnitude can be read at any frequency on the 
low-frequency asymptote and K, computed from Eq. (5.18). 
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FIGURE 5.8 
Determination of K, 
from the Bode plot. 
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FIGURE 5.9 
System description. 
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As an example of the determination of steady-state errors, a Bode magnitude plot 
of an open-loop plant plus compensation is shown in Fig. 5.8. Because the slope 
at the low frequencies is —1, we know that the system is type I. The extension of 
the low-frequency asymptote crosses w = | rad/s at a magnitude of 10. Therefore, 


K, = 10 and the steady-state error to a unit ramp for a unity feedback system 
would be 0.1. 5 
Specifications 


A natural specification for system performance in terms of frequency response is the 
bandwidth, defined to be the maximum frequency at which the output of a system 
will track an input sinusoid in a satisfactory manner. By convention, for the system 
shown in Fig. 5.9 with a sinusoidal input r, the bandwidth is the frequency of r 
at which the output y is attenuated to a factor of 0.707 times the input (or down 3 
dB) relative to the zero-frequency gain. Figure 5.10 shows the idea graphically. 


FIGURE 5.10 
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peak definition. 
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Bandwidth is a measure of speed of response and is therefore similar to time- 
domain measures like rise time and peak time or the s-plane measure of dominant- 
root(s) natural frequency. In fact, if the KG(s) in Fig. 5.9 is such that the closed- 
loop response is given by Fig. 5.5, it can be seen that the bandwidth will be equal 
to the closed-loop root, natural frequency (that is w,,) for a closed-loop damping 
ratio of ¢ = 0.7. For other damping ratios, the bandwidth is approximately equal 
to the natural frequency of the closed-loop roots, with an error typically less than 
a factor of 2. 

Another specification related to the frequency response is the resonant peak 
magnitude M,. It is defined in Fig. 5.10 and is shown in Fig. 5.5 to be generally 
related to the damping of a system. In practice, M, is rarely used; instead, the 
gain and/or phase margin of a system is the preferred specification to indicate the 
degree of damping or stability of a system. The definitions of these margins are 
given in Section 5.6; they depend on stability ideas to be described in the next two 
sections. 


Stability 


In the early days of electronic communications, most applications were judged 
in terms of their frequency response. It is therefore natural that when the feed- 
back amplifier was introduced, techniques to determine stability in the presence of 
feedback were based on this response. 
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FIGURE 5.11 

Stability example: 

(a) system definition and 
(b) root locus. 


Suppose the closed-loop transfer function of a system is known. We can deter- 
mine the stability of a system by simple inspection of the denominator in factored 
form (the factors give the system roots)—observing whether the real parts are pos- 
itive or negative. But the closed-loop transfer function is not usually known; in 
fact, the whole idea of the root-locus technique is to find the denominator factors 
of the closed-loop transfer function, given the open-loop transfer function. It is also 


(a) 


5.4 / Stability 263 


possible to determine closed-loop stability by evaluating the frequency response 
of the open-loop transfer function KG( jw) (assuming unity feedback*) and then 
performing a simple test on that response. Note that factoring the denominator of 
the closed-loop transfer function is not required, just evaluation of KG(jw). Now 
let’s explain how this comes about. 

Suppose we have a system whose root locus behaves as shown in Fig. 5.11— 
that is, instability results if K has a sufficiently high value. The neutrally stable 
points lie on the imaginary axis, that is, where s = jw. Furthermore, we saw in 
Chapter 4 that all points on the locus have the property that 


IKG(s)| = 1 
and 


ZG(s) = 180°. 


Therefore at the point of neutral stability we see that these root-locus conditions 
hold for s = jw, which means that 


IKG(jo)| = 1 and ZG(jw) = 180°. (5.19) 


Thus a plot of the frequency-response magnitude and phase of a system that is 
neutrally stable (that is, with K so that the closed-loop roots fall on the imaginary 
axis) will satisfy the conditions of Eq. (5.19). Figure 5.12 shows the frequency 
response for the system whose root locus is plotted in Fig. 5.11. The magnitude 
response corresponding to K = 2 passes through | at the same frequency (w = | 
rad/s) at which the phase passes through 180°, as indicated by the conditions in 
Eq. (5.19). 

For the example shown in Fig. 5.11, it can be seen from the root locus in 
Fig. 5.11 that any K less than the value at the neutrally stable point will result in a 
stable system. The frequency response in Fig. 5.12 shows plots of |KG(jw)| with 
various values of K. At the frequency w where the phase 2G(jw) = —180°, 
(w = | rad/s) the magnitude |KG(jw)| will be < 1 for stable values of K 
and > | for unstable values of K. Therefore, we have a stability condition based 
on the character of the open-loop frequency response, 


IKG(jo) «1 at — ZG(je) = —180°. (5.20) 


This stability criterion holds for all systems where increasing gain leads to insta- 
bility, the most common situation. However, there are systems where an increasing 
gain can lead from instability to stability (conditionally stable systems). The con- 


* The unity feedback assumption does not limit the application of this concept because, for purposes of 
stability analysis, one can transform any system to the unity feedback configuration by simply including 
the transfer function of the feedback path as part of the open-loop transfer function K G( jw). 
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ditions for neutral stability given by Eq. (5.19) always hold; therefore, the only 
question in the stability criterion of Eq. (5.20) is whether |KG(j@)| should be 
< ] or > 1 at the frequency where 2G(jw) = —180?. One way to resolve the 
ambiguity is to perform a rough sketch of the root locus to resolve the key question: 
does increasing gain lead to stability or instability? Another more rigorous way to 
resolve the ambiguity is to use the Nyquist stability criterion, the subject of the 
next section. 

Quantities that measure the degree of stability have been defined that are di- 
rectly related to the stability criterion of Eq. (5.20). The factor by which the gain 
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is less than the neutral stability value is referred to as the gain margin. It can be 
read directly from the frequency response in Fig. 5.12 by measuring the distance 
between the |KG(j@)| curve and the magnitude = 1 line at the frequency where 
ZG(jw) = —180°. We see from the figure that the K = 0.1 case is stable and 
the gain margin (GM) is = 20 (26 dB). The K = 2 case is neutrally stable and 
the GM = 0 while the K = 10 case is unstable and has a GM = 0.2 (—14 dB). 
Note that the GM is the factor by which the gain K can be raised before instability 
results. A GM with a magnitude < 1 (« 0 if in dB) indicates an unstable system. 
The GM can also be determined from a root locus versus K by noting K at the 
point the locus crosses the jw axis and K at the design point. The GM is the ratio 
of these two values of K. 

Another measure that is used to indicate the degree of stability is the phase 
margin or PM. It is the amount by which the phase of G( jw) exceeds —180? when 
[KG(j@)| = 1, which is an alternate way of measuring the degree to which the 
stability conditions of Eq. (5.20) are met. From Fig. 5.12 we see that the phase 
margin (PM) is approximately 80? for the K = 0.1 case and —35? for K = 10. A 
positive PM is required for stability. Note that the two stability measures, PM and 
GM, together determine how far that the complex quantity K G( jc) passes from 
the —1 point, which is another way of stating the neutral stability point specified 
by Eq. (5.19). 

In summary, the stability of a closed-loop system can be determined by ex- 
amining the magnitude and phase of the open-loop transfer function. The stability 
criterion is given by Eq. (5.20) for systems where increasing gain eventually causes 
instability, the most common case. For systems that are unstable for low values of 
gain and become stable as the gain is raised past some critical point, the inequality 
in Eq. (5.20) needs to be reversed to establish a stability criterion. Resolution of 
this ambiguity can be accomplished by making a rough sketch of the system's root 
locus versus the gain K. Alternately, one can study a system's stability using the 
Nyquist criterion described in the next section, a criterion with no ambiguities. 
However, the Nyquist criterion is fairly complex and one can easily lose sight 
during its study that, for most systems, there is a simple relationship that exists 
between closed-loop stability and the open-loop frequency response. Study of the 
Nyquist criterion will allow the student to determine stability from the frequency 
response of complex systems, perhaps with one or more resonances, where the 
magnitude curve crosses | several times and/or the phase crosses — 180° several 
times. | 


The Nyquist Stability Criterion 


For most systems an increasing gain eventually causes instability. Therefore, in 
the very early days of feedback control design, this relationship between gain and 
stability margins was assumed to be the correct one. However, designers would 
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FIGURE 5.13 
Contour evaluations: (a) s-plane plot of poles and zeros of H,(s) and the contour C\, (b) H\(s) for s on C, 
(c) s-plane plot of poles and zeros of H»(s) and the contour C4, (d) H»(s) for s on Cj. 
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occasionally find in the laboratory that this relationship would reverse itself and 
an amplifier would go unstable if gain was decreased. This situation had caused 
some confusion and motivated Harry Nyquist of the Bell Telephone Laboratories 
to study the problem in 1932. His study explained the occasional reversals and 
resulted in a more sophisticated analysis with no loopholes. Not surprisingly, his 
test has come to be called the Nyquist stability criterion. The basic concept used 
in it is based on the argument principle, as explained below and in more detail in 
Appendix B. 

Suppose the H;(s) whose poles and zeros are indicated in Fig. 5.13(a) is 
evaluated for s taking on the values of the contour Cı. The angle a of H (s) in 
Fig. 5.13(b) will change some as s traverses C, but will not undergo a net change 
of 360? as long as there are no poles or zeros within Cı. This means that the plot 
of H,(s) [Fig. 5.13(b)] will not encircle the origin. This follows from the fact that 
a is the sum of the angles indicated in Fig. 5.13(a), and the only way that o can 
be changed by 360° after s executes one full traverse of C, is for C, to contain 
a pole or zero. H2(s) has a singularity within C, as shown in Fig. 5.13(c). Here, 
the angle from the pole within C; undergoes a net change of 360° after one full 
traverse of Cı, and therefore the argument of H2(s) undergoes the same change, 
causing H2 to encircle the origin, as shown in Fig. 5.13(d). Thus we have the 
essence of the argument principle: A contour evaluation of a complex function will 
only encircle the origin if the contour contains a singularity of the function. The 
principle can be extended by allowing multiple singularities (poles or zeros) within 
the contour. The number and direction of origin encirclements then change. For 
example, if the number of poles and zeros within C, were the same, then there 
would be no encirclement of the origin. 

To apply the principle to control design we let the C, contour in the s plane 
encircle the entire right-half plane (RHP). (See Fig. 5.14.) The resulting evaluation 
of an H(s) will only encircle the origin if H(s) has a right-hand plane pole or zero. 

As stated already, a key idea that makes all this useful is that a contour evalu- 
ation of an open-loop K G(s) can be used to determine stability of the closed-loop 
system. Specifically, for the system in Fig. 5.9, the closed-loop transfer func- 
tion is 

Y(s) |. KG(s) 


Bu ^ ^TIEGUD 


Therefore the closed-loop roots are the solutions of 
1+ KG(s) = 0. 


If the evaluation contour of s enclosing the RHP contains a zero or pole of 
1 + KG(s), then the evaluated contour of 1 + KG(s) will encircle the origin. But 
1+ KG(s) is simply K G(s) shifted to the right by 1. (See Fig. 5.15.) Therefore, 
if 1 + KG(s) encircles the origin, KG(s) will encircle —1 and we then know that 
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1 + KG(s) contains a pole or zero. Presentation of the evaluation of K G(s) in this 
manner is often referred to as a Nyquist plot. 

To unscramble whether an encirclement is due to a pole or zero, we write 
1 + KG(s) in terms of poles and zeros of KG(s); that is, 

1+ KG(s) = 1+ ko) = BATEU (3.21) 
a(s) a(s) 
and we see that the poles of 1 + KG(s) are also the poles of G(s). Since the 
poles of G(s) [or factors of a(s)] are known, the rare existence of any of these 
in the RHP can be accounted for. Assuming for now that there are no poles of 
G(s) in the RHP, an encirclement of —1 by KG(s) indicates an unstable root of 
the closed-loop system. 

We can embellish this basic idea by noting that a clockwise C; contour enclos- 
ing a zero of 1 + KG(s)—that is, closed-loop-system root— will result in a clock- 
wise K G(s) encirclement of —1. Likewise, if C; encloses a pole of 1 + KG(s)— 
that is, if there is an unstable open-loop pole—there will be a counterclockwise 
K G(s) encirclement of —1. Furthermore, if two poles or two zeros of 1 + KG(s) 
are in the RHP, KG(s) will encircle —1 twice, and so on. The net number of 
clockwise encirclements, N, equals the number of zeros (closed-loop-system roots) 
in the RHP, Z, minus the number of poles in the RHP, P, that is, 


N=Z = P. 


A simplification results from the fact that any K G(s) that represents a physical 
system will have zero response at infinite frequency. This means that the big arc of 
C; at infinity (Fig. 5.14) results in K G(s) being an infinitesimal point at the origin 
for that portion of Cı. Therefore, a complete evaluation of a physical K G(s) is 
accomplished by letting s traverse the imaginary axis from — jœ to +j®. The 
evaluation of KG(s) from s = 0 to 7 jo has already been discussed in Section 
5.2 under the context of finding the frequency response of KG(s). Because K G(s) 
is a real function, the remainder of KG(s), s = — j^ to 0, can be obtained by 
reflecting the s = 0 to + jœ portion about the real axis, and the entire K G(s) plot 
is easily obtained. Hence we see that closed-loop stability can be determined in all 
cases by examination of the frequency response of the open-loop transfer function. 

In practice, many systems behave like those discussed in the previous section, 
and designers need not carry out a complete evaluation of K G(s) with subsequent 
inspection of the —1 encirclements. A simple look at the frequency response suf- 
fices to determine stability based on the gain and phase margins as discussed in 
the previous section. Alternatively, the stability can be defined in terms of the —1 
encirclements, that is, the Nyquist stability criterion. In the case of a complex 
system where the rules become ambiguous, a designer will want to perform the 
complete analysis, the process for which can be summarized as follows: 


1. Plot KG(s) for s = — jœ to +j®. Do this by first evaluating points from 
s = 0 to * jo (the frequency response), then reflecting the image about the 
real axis and adding it to the preceding image. 
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FIGURE 5.16 
Definition of Example 
5.4. 


EXAMPLE 5.4 


FIGURE 5.17 
Root locus of Example 
5.4 versus K. 


2. Evaluate the number of clockwise encirclements of — 1 and call that number N. 
Do this by drawing a straight line in any direction from —1 to ©. Then count the 
net number of clockwise crossings of the straight line by G(s). If encirclements 
are in the counterclockwise direction, N is negative. 

3. Determine the number of unstable (RHP) poles of G(s) and call that number P. 


4. The number of unstable closed-loop roots, called Z, is then 
£ = N+P. (5.22) 


Let’s now follow a rigorous application of this procedure through some 
examples. 


The first example is defined in Fig. 5.16. As can be seen from the root locus in 
Fig. 5.17, it is stable for all values of K. The magnitude of the frequency response 
of KG(s) is plotted in Fig. 5.18(a) for K = 1, and the phase is plotted in Fig. 
5.18(b); this is the typical method of presenting frequency response and represents 
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FIGURE 5.18 

Open-loop frequency 
response of Example 5.4: 
(a) magnitude and 

(b) phase. 
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the evaluation of G(s) from s = 0 to j^. The same information is replot- 


ted in Fig. 5.19 in the Nyquist plot form. The information from Figs. 5.18(a) 
and (b) becomes the arc from G(s) = +1 (œw —0)to G(s) - 0 (w = œ) 
that lies below the real axis. The portion of the C, arc at infinity shown in Fig. 
5.14 transforms into G(s) = 0; therefore a continuous evaluation of G(s) with 
s traversing C, is completed by simply reflecting the lower arc about the real 
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FIGURE 5.19 
Nyquist plot of the 
evaluation of K G(s) 
for s = C, and 

K — l in Example 
5.4. 


EXAMPLE 5.5 


FIGURE 5.20 
Definition of Example 
5.5. 
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G(s) for s 2 —jo to 0 


G(s) for s 20 to + jo 


axis. This creates the portion of the contour above the real axis and completes the 
Nyquist plot. We note from the plot that it does not encircle the —1 point and, 
therefore, N = 0. Also, there are no poles of G(s) in the RHP, thus, P = 0; 
therefore, Z = 0, indicating there are no unstable roots of the closed-loop system 
for K = 1. 

Although we could replot K G(s) for other values of K, it is more convenient 
to rescale the Nyquist plot and continue to examine G(s) to determine stability 
for all values of K. This is possible because an encirclement of —1 by KG(s) 
is equivalent to an encirclement of —1/K by G(s). For this example, G(s) never 
crosses the negative real axis except at G(s) = 0; therefore it will never encircle 
—1/K as long as K > 0. This result is identical to that shown by the root locus, 
as it should be! RE 


The second example is defined in Fig. 5.20. It is the same system discussed in 
Section 5.4, and its root locus in Fig. 5.11 shows that this system is stable for 


FIGURE 5.21 
Frequency response of 
Example 5.5: 

(a) magnitude and 

(b) phase. 
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(a) 


small values of K but unstable for large values of K. As explained in Example 5.4, 
G(s) alone will be evaluated instead of K G(s) to eliminate the need for repeated 
evaluations with different values of K. The magnitude and phase of G(s) in Fig. 
5.21 are transformed to the Nyquist plot shown in Fig. 5.22. It is interesting to 
note the large arc at infinity that arises from the open-loop pole at s = 0. This pole 
creates an infinite magnitude of G(s) at w = 0, and, in fact, any pole or zero on 
the imaginary axis will create an arc at infinity. To correctly determine the number 
of —1 encirclements, it is necessary to draw the arc at infinity on the proper side. 
That is, should it cross the positive real axis, as shown in Fig. 5.22, or should it 
cross the negative real axis? It is also necessary to assess whether the arc should 
sweep out 180? (as seen in Fig. 5.22), 360°, or 540°. 
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FIGURE 5.22 


Nyquist plot for Example 5.5. 


w<0 


Imaginary 


Arc at x 
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A simple artifice suffices to answer all these questions. Modify the C, contour 
to take a small detour around the pole. It makes no difference to the final stability 
question which way, but it is more convenient to go to the right, as shown in Fig. 
5.23, because then no open-loop poles are introduced within the C ; contour (which 
means the value of P remains equal to 0). Since the phase of G(s) is the negative 
of the sum of the angles from all poles, it can be seen that the evaluation results 
in a Nyquist plot going from +90° for s just below the pole at s = 0, across the 


FIGURE 5.23 
Description of C, 
contour enclosing RHP 
for Example 5.5. 
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positive real axis to —90? for s just above the pole. Had there been two poles at 
s = 0, the Nyquist plot at infinity would have executed a full 360? arc, and so 
on for three or more poles. Furthermore, for a pole elsewhere on the imaginary 
axis, a 180? clockwise arc will also result but will be oriented differently than the 
example in Fig. 5.22. 

There are two possibilities for the location of —1/K —either inside the two 
loops of the Nyquist plot or outside the Nyquist contour completely. For large 
values of K (K; in Fig. 5.22), —1/K will lie inside the two loops; hence N = 2 
and therefore Z = 2, which indicates two unstable roots. For small values of K 
(K, in Fig. 5.22), —1/K lies outside the loops, thus N = 0, Z = 0, and all roots 
are stable. Again, all this is in agreement with the root locus. 

For the prior example system and many similar systems, it can be seen that the 
encirclement criterion reduces to a very simple test for stability based on the open- 
loop frequency response: The system is stable if |KG(j@)| < 1 when the phase 
of G(j«) is —180°. This is identical to the stability criterion given in Eq. (5.20); 
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Definition of Example s(s/10— 1) 
2,5. 
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Root locus for Example 5.6. 
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however, in this case we don't require the root locus to determine if |KG(jw)| 
should be < 1 or > 1. i 


EXAMPLE 5.6 The third example is defined in Fig. 5.24, and its root locus is sketched in Fig. 
5.25. The open-loop magnitude and phase are shown in Fig. 5.26. By examining 
the |KG(j@)| and 2G(j@) graphically, one can see that the pole being in the RHP 
causes the magnitude to behave just as if the pole were in the LHP, while it causes 
the phase to increase by 90° instead of the usual decrease at a pole. Any system 
with a pole in the RHP is unstable; hence it would be impossible to determine its 
frequency response experimentally because the system would never reach a steady 
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FIGURE 5.27 
Nyquist plot for Example 5.6. 
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FIGURE 5.28 
C, contour for Example 
5.6. 
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sinusoidal response to the sinusoidal input. It is, however, possible to compute the 
magnitude and phase of the transfer function according to the rules in Section 5.2. 
The pole in the RHP affects the Nyquist encirclement criterion because the value 
of P in Eq. (5.22) is +1. 

Translation of the frequency-response information to the Nyquist plot (Fig. 
5.27) is accomplished as in the previous examples; as before, the C, detour around 
the pole at s = 0 (Fig. 5.28) creates a large arc at infinity. This arc crosses the 
negative real axis because of the 180? phase contribution of the pole in the RHP. 

For large values of K (K; in Fig. 5.27), there is one counterclockwise encircle- 
ment; hence N = —1. But since P = 1 from the RHP pole, then Z = N+P = O0, 
and there are no unstable system roots. For small values of K (K, in Fig. 5.27), 
N = +1 because of the clockwise encirclement, and Z = 2, indicating two unstable 
roots. These results agree with the root locus, as they should. The stability bound- 
ary occurs at|KG(jw)| = 1 forthe phaseof 2G(j@) = —180°, as will always occur; 
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9.6 


however, in this case, |KG( jo)| must be > 1 for the correct number of —1 
encirclements to achieve stability. & 


The existence of the RHP pole in the last example affected the Bode plotting 
rules of the phase curve and affected the relationship between encirclements and 
unstable closed-loop roots because P = 1 in Eq. (5.22). For systems with an RHP 
zero, referred to as a nonminimum-phase system,* the Bode phase plot decreases 
at the zero breakpoint instead of the usual phase increase that occurs for an LHP 
zero. With the exception of this difference in the phase plot, a nonminimum-phase 
zero has no effect on the Nyquist stability criterion. 


Stability Margins 


A large fraction of control-system designs behave in a pattern roughly similar to 
that of the example system in Section 5.4 and Example 5.5 in Section 5.5; similar 
in that the systems go unstable if the gain increases past a certain critical point. 
For these cases, it is convenient to define the gain margin (GM) and phase margin 
(PM) as was done in Section 5.4. Based on the ideas in Section 5.5, we see 
that the margins are measures of how close the Nyquist plot comes to encircling 
the —1 point as shown in Fig. 5.29. It shows that the gain margin is a measure 
of how much the gain can be raised before instability results for a system like 
Example 5.5. The phase margin is the difference between the phase of G(j@) and 
—180? when |KG(j )| crosses the magnitude = 1 circle, with the positive value 
assigned to the stable case (i.e., no Nyquist encirclements for a system like Ex- 
ample 5.5). 

It is easiest to determine these. margins directly from the magnitude and phase 
frequency-response plots. The phase margin is defined with respect to the frequency 
where the gain is unity, or 0 dB, and the gain margin is defined with respect to the 
frequency where the phase is — 180°. The term “crossover frequency” is often used 
to refer to the frequency at which the gain is unity, or 0 dB. Figure 5.30 shows 
the same data plotted in Fig. 5.21, but for the case with K — 1. The margins 
indicated in the figure indicate that PM = 22? and GM - 2. 

One of the very useful aspects of frequency-response design is the ease with 
which the designer can evaluate the effects of gain changes. In fact, the PM for 
any value of K can be determined from Fig. 5.30 without redrawing the magnitude 
or phase information. We only need to indicate on the figure where |K G(j@)| would 


* A system with a zero in the RHP undergoes a net change in phase, when evaluated for frequency 
inputs between zero and infinity which is greater for a given magnitude plot than if all zeros were in 
the LHP; hence the name, nonminimum phase. 
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FIGURE 5.29 
Nyquist plot for GM and 
PM definition. 


equal | for selected trial values of K. This is done by the dashed lines in Fig. 
5.31, and we see that K = 5 yields an unstable PM of —22° while a gain of 
K = 0.5 yields a PM of +45°. Furthermore, if you wish a certain PM, say 70°, 
read the value of |G(jw)| that is at the frequency that would create the desired 
PM (w = 0.2 rad/s yields 70°, where |G(j«)| = 5), and note that the magnitude 
at this frequency is 1/K. Therefore, Fig. 5.31 shows that a PM of 70? will be 
achieved with K — 0.2. 

Both margins offer a measure of the degree of stability and are sometimes 
used directly to specify control-system performance. It is therefore of interest to 
relate the margins to other measures of the degree of stability. For simplicity, let's 
take an open-loop second-order system, 

On 
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FIGURE 5.31 
PM versus K from the 
frequency-response data. 
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FIGURE 5.32 
Damping ratio versus 
phase margin (PM). 


With unity feedback, the closed-loop system 


o? 


= 5.23) 


Fip = e 
(s) s* + wns + w? 


results. It can be shown (Problem 5.21) that the relationship between the PM and 
¢ in the system above is 


PM = ar / J/1 + 4¢4 - 20 | (5.24) 


and it is plotted in Fig. 5.32. Note from the figure that the function is approximately 
a straight line up to a PM of about 60°. The dashed line in the figure shows a straight 
line approximation to the function where 


P 
[e Tu (5.25) 


It is clear that the approximation only holds for phase margins below about 70°. 
Furthermore, Eq. (5.24) is only accurate for the second-order system of Eq. (5.23). 
In spite of these limitations, the relationship in Eq. (5.25) is often used as a rule 
of thumb in relating the degree of stability in terms of PM. It is useful as a 
starting point; however, the designer should always check the actual damping of 


a design as well as other aspects of the performance before calling the design 
complete. 


Damping ratio ¢ 


Phase margin, deg 


FIGURE 5.33 

Transient response over- 
shoot and frequency 
response: resonant peak 
versus phase margin 
(PM) for second-order 
system. 
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By using the relation between M, and ¢ seen in Fig. 5.5, which was derived 
for the same system (Eq. 5.23), we can transform the information in Fig. 5.32 to 
relate M, to the PM. This is depicted in Fig. 5.33, along with the step response 
overshoot M,, and provides additional rule-of-thumb data to aid in the evaluation 
of a control system based on its PM. 

Many engineers think directly in terms of PM in judging whether a control 
system is adequately stabilized. In using PM this way, a phase margin of 30° is often 
judged to be the lowest acceptable PM, with values above 30° desirable. In addition 
to being assured that a system design is sufficiently stable via the PM, a designer 
typically would also be concerned with meeting some kind of “speed of response” 
type of specification such as bandwidth as discussed in Section 5.3. In terms of 
the frequency-response parameters discussed so far, the crossover frequency would 
best describe a system’s speed of response. This idea will be discussed further in 
Sections 5.7 and 5.8. 

In some cases, the PM and GM notions break down. For first- and second- 
order systems, the phase never crosses the — 180° line; hence the GM is always o 


FIGURE 5.34 

Example of system where 
increasing gain leads 
from instability to 
stability: (a) root locus 
and (b) Nyquist plot. 
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and not a useful design parameter. For higher-order systems, it is possible to have 
more than one frequency where |KG(jw)| = 1 or where 2KG(jw) = —180°, 
and the margins as previously defined would need clarification. An example of this 
can be seen in Fig. 7.13 where the magnitude crosses | three times. The figure 
indicates that the PM is defined by the first crossing, a decision that was made 
because the PM at this crossing was the minimum of the values and thus the most 
conservative assessment of stability. A Nyquist plot based on the data in Fig. 7.13 
would show that the portion of the Nyquist curve closest to the —1 point is the 
critical indicator of stability and, therefore, use of the crossover frequency yielding 
the minimum value of PM is the logical choice. 


An example of a system where increasing gain causes a transition from instability 
to stability has an open-loop transfer function 


2 
Gis) = K(s is 10) | 
"E 

The root locus in Fig. 5.34(a) shows that the system is unstable for K — 5 and 
stable for K > 5. The Nyquist plot in Fig. 5.34(b) was drawn with K = 7, which 
is a stable value. Determination of the margins according to Fig. 5.29 yields a PM 
of +10° and a GM of 0.7. According to the rules above, these two margins yield 
conflicting signals on the system's stability. To resolve the issue, a count of the 
Nyquist encirclements show that the K = 7 case drawn has one clockwise and 
one counterclockwise encirclement of the —1 point, hence no net encirclements, 
and the system is confirmed to be stable. A system such as this, where for stability 
the gain must be higher than some value, is referred to as a conditionally stable 
system. m 


A Nyquist plot for 


85(5 + Ds 4-1 0 6.57) 
GG) = = 
sst Lees + 1+ 107) 

is shown in Fig. 5.35. It shows a situation where there are two crossover frequencies 
with approximately equal values of PM, but the key indicator of stability is the 
proximity of the Nyquist plot as it approaches the —1 point while crossing the 
real axis. In this case, the most relevant margin to use for design as a measure of 
the degree of stability would be the GM because it alone indicates the marginal 
stability of this system. E 
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FIGURE 5.35 
Nyquist plot of a 
complex system. 
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FIGURE 5.36 
Definition of the vector 
margin on the Nyquist 
plot. 
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Unstable open-loop systems (see the example in Fig. 5.27) exhibit stability 
criteria that are different than those defined by Fig. 5.29 because there needs 
to be one —1 encirclement for each unstable pole in order for the closed-loop 
system to be stable. The GM and PM as previously defined can be misleading 
and should therefore be modified by reverting back to the Nyquist stability crite- 
rion. 

It should be clear that a designer needs to be judicious in the application of 
the margin definitions as described in Fig. 5.29. The stability margin of a system 
can only be rigorously assessed by examining the Nyquist plot encirclements and 
by determining the plot’s closest approach to the —1 point. To aid in this analysis, 
a vector margin was introduced by O. J. M. Smith (1958) that was defined to 
be the distance to the —1 point from the closest approach of the Nyquist plot. 
Figure 5.36 shows the idea graphically. Although use of this margin definition 
would remove all ambiguities in the assessment of stability, it is more difficult to 
compute than phase and gain margins and has not been used extensively in design 
over the years. With the widespread use of computer-aided calculations, the idea 
of having a single margin parameter to describe the degree of stability is quite 
feasible. 


5.6.1 Multivariable Systems 


Multivariable systems, where there are more than one input and/or more than 
one output (MIMO systems), have posed difficulties for designers because there 
are so many aspects of the design that all apparently need attention. This text 
has dealt with closing one loop and has considered aspects of stability, tracking 
errors, and response characteristics of that one loop. For MIMO systems, the 
same considerations need to be addressed for each loop; however, it is not always 
straightforward to identify a “loop” because there are transfer functions from each 
input to all outputs. For example, for a 3-input, 3-output system, there are 9 transfer 
functions between inputs and outputs. 

The singular value decomposition of the matrix of transfer functions evalu- 
ated for s = jw has proven useful in resolving the complexities of MIMO design 
(Doyle and Stein, 1981; Safonov, Laub, and Hartmann, 1981). The essential idea 
is to reduce the matrix of transfer functions to one critical gain versus frequency, 
that is, the maximum singular value of the matrix, F, and to examine that quantity 
in a manner similar to the one used to examine the frequency-response magnitude 
of a single-input, single-output (SISO) transfer function G. Stability margins in 
terms of F have been defined for the MIMO case following the stability margin 
ideas presented in this Section 5.6 for the SISO case. Section 5.11 discusses the 
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sensitivity of control systems and refines the MIMO design ideas introduced here. 
A discussion and definition of the singular value decomposition of a matrix is 
contained in Appendix C. 


Bode's Gain-Phase Relationship 


One of Bode's important contributions is his theorem that states: "For any stable 
minimum phase system (meaning one with no RHP zeros or poles), the phase of 
G(jq@) is uniquely related to the magnitude of G(j@).” 

When the slope of |G( j«)| versus w on a log-log scale persists at a constant 
value for something close to a decade of frequency, the relationship is particularly 
simple: 


ZG(jo) =n x 90°, (5.26) 


where n is the slope of |G(jc)| in units of decade of amplitude per decade of 
frequency. For example, in considering the magnitude curve alone in Fig. 5.37, it 
is seen that Eq. (5.26) can be applied to the two points shown as w; and w2, which 
are a decade removed from the change in slope, to yield the approximate values 
of phase, —180° and —90°. The exact phase curve shown in the figure verifies 
that, indeed, the approximation is quite good. It also shows that the approximation 
will degrade if the evaluation is performed at frequencies closer to the changes in 
slope. 
An exact statement of the Bode gain-phase theorem is 


1 (*°/dM 
ZG(jwo) = J (G | Wao du radians, (5.27) 


where 


M = log magnitude, In |G( jo)|, 
u = log normalized frequency = In(w/a9), 
dM/du = slopen, as defined in Eq.(5.26), 
W(u) = weighting function = In(coth |u|/2). 


Figure 5.38 is a plot of the weighting function W(u) and shows how the phase 
is most dependent on the slope at «o: It is also dependent, though to a lesser degree, 
on slopes at neighboring frequencies. The figure also suggests that the weighting 
could be approximated by an impulse function centered at «o, which is precisely 
the approximation made that arrives at Eq. (5.26). 
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FIGURE 5.38 
Weighting function in 
Bode’s gain-phase 
theorem. (From Clark, 


1962.) 
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In practice, Eq. (5.27) is never used. But the approximate relation in Eq. (5.26) 
is used as a guide to infer stability from |G(jw)| alone. When |KG(jo)| = 1, 


ZG(jw) = —90? ifn = —1, 
ZLG(jw) = -180° ifn = -2. 


For stability we want 2G(jw) > —180° for a PM > 0. Therefore we adjust 
the |KG(jw)| curve so that it has a slope of —1 at the |KG(jw)| = 1 crossover 
frequency. If the slope is —1 for a decade above and below the crossover frequency, 
the PM would be approximately 90°; however, to ensure a reasonable PM, it is 
usually only necessary to insist on a —1 slope (—20 dB per decade) persisting for 
a decade in frequency that is centered at the crossover frequency. 


To illustrate the power of this idea, let's apply it to the design of compensation 
for the spacecraft attitude-control problem. We wish to find a suitable D(s) in Fig. 
5.39 that will provide good damping and a bandwidth of approximately 0.2 rad/s. 
The magnitude of the frequency response of the spacecraft, |G(jw)|, is plotted in 


FIGURE 5.39 
Example definition. 


FIGURE 5.40 
Spacecraft frequency- 
response magnitude. 
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Fig. 5.40 and clearly requires some reshaping since it has a slope of —2 or —40 
dB per decade everywhere. The simplest compensation to do the job consists of 
using proportional-plus-derivative terms, which produces 


KD(s) = K(Tps + 1). 


The gain K will be adjusted to produce the desired bandwidth, while the break- 
point o; = 1/Tp will be adjusted to provide the —1 or —20 dB per decade slope 
at crossover. For design purposes, it is convenient to assume that the crossover 
frequency and the closed-loop system bandwidth are the same, although we will 
need to verify this when we are through. The actual design process to achieve the 
desired specifications is now very simple: Pick K to provide a crossover at 0.2 
rad/s and pick «, about a factor of 4 lower than the crossover frequency so that 
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FIGURE 5.41 
Compensated open-loop 
transfer function. 
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the slope is —1 in the vicinity of crossover. Figure 5.41 shows the steps taken to 
arrive at the final compensation: 


1. Plot |G( æ). 

2. Modify the plot to include , With «o, = 0.05 rad/s (Tp = 20). 
3. Find that |DG| = 100 where it crosses w = 0.2 rad/s. 

4. Compute 


Therefore K D(s) = 0.01(20s + 1) will meet the specifications and the design 
is complete. 


If the phase curve is drawn for the DG above, it will be found that the phase 
margin is 75°, certainly quite adequate. Furthermore, Fig. 5.42 is a plot of the 


FIGURE 5.42 
Closed-loop frequency 
response. 
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FIGURE 5.43 
Simplified system 
definition. 
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that, indeed, the crossover frequency and the bandwidth are almost identical in this 
case. B 


Closed-Loop Frequency Response 


Generally the match between the crossover frequency and the bandwidth is not as 
good as in Example 5.9. We can help establish a more exact correspondence by 
making a few observations. For the simplified system shown in Fig. 5.43, where 
IG(j«)| has the typical property that 


IG(jo)| > 1 fore < we, 
IG(jo)| « 1 for w > we, 


where we = crossover frequency, the closed-loop frequency-response magnitude 
is approximated by 


G(jo) zm] forc < we 
F| = | | 


1+G(jw)|| =|G| foro > o.. 


In the vicinity of crossover where |G(jw)| = 1, |F| depends heavily on the PM. 
One of 90° means that ZG(j«.) = —90°, and therefore |F(jw,)| = 0.707. A 
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FIGURE 5.44 


Closed-loop bandwidth versus PM. 
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PM of 45°, on the other hand, yields |F(jw,)| = 1.31. In fact, the values of M, 
plotted in Fig. 5.33 will usually be quite close to |F(j«.)|.* These approximations 
are used to generate the curves of |F(j@)| in Fig. 5.44. It shows that the band- 
width for smaller PMs is typically somewhat greater than w, though usually less 
than 2w.. 


Compensation 


As already discussed in Chapters 3 and 4, dynamic elements (or compensation) are 
often added to feedback control systems to improve their stability or error charac- 
teristics. Here, we wish to discuss compensation again in terms of its frequency- 
response characteristics. 

It is desirable to have the ability to analyze compensation in terms of its effect 
on the frequency response of a system as well as its effect on a root locus as 
we did in Chapter 4. This ability greatly aids the designer in reaching the best 
compromise in selecting the parameters of the compensation and in gaining insight 
into the ramifications of alternate compensation designs. 

Section 3.2 discusses the basic types of feedback: proportional, derivative, 
and integral. Section 4.5 discusses the ideas of dynamic compensation: the lead 
network, which approximates proportional-plus-derivative feedback and the lag 
network, which approximates proportional-plus-integral control. 


*From the geometry of the Nyquist plot, it is straightforward to show that |F (jw ,)| = 1/(2 sin(PM/2)) 
for any phase margin (see Problem 5.33). 
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5.9.1 PD Compensation 


We will start the discussion of compensation design via the frequency response 
with proportional-plus-derivative control. Its transfer function is given by 


D(s) = K(Tps + 1) (5.28) 
and it was shown in Fig. 4.14 to have a stabilizing effect on the root locus of 
a second-order system. The frequency-response characteristics of Eq. (5.28) are 


shown in Fig. 5.45. A stabilizing influence is apparent by the increase in phase at 
frequencies above the breakpoint 1/Tp. This compensation is used by locating 1/Tp 


| D(s) | 


FIGURE 5.45 
Frequency response 
of proportional-plus- 
derivative control. 
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so that the increased phase occurs in the vicinity of crossover [|D(s)G(s)| = 1], 
thus increasing the phase margin. Also note that the magnitude of the compensation 
continues to grow with increasing frequency. This feature is undesirable since it 
amplifies the high-frequency noise that is typically present in any real system. It 
is also the reason for the statement in Section 4.5 that this pure derivative form of 
compensation gives trouble. 


5.9.2 Lead Compensation 


In order to alleviate the high-frequency amplification and the associated noise sen- 
sitivity of PD compensation, a first-order pole is introduced in the denominator at 
frequencies much higher than the numerator breakpoint. Thus the phase increase 
(or *lead") still occurs, but the amplification at high frequencies is limited. The 
resulting lead compensation has a transfer function of 


Ts +1 


D = K————, 
(s) aTs+1 


(5.29) 
where œ < 1. Figure 5.46 shows the frequency response of this lead compensation. 
Note that a significant amount of phase lead is still provided, but with much less 
amplification at high frequencies. The compensation shown in Fig. 5.46 produces 
the maximum amount of phase lead midway between the breakpoints, 1/T and 
l/aT , on the log scale. This will be the case for any lead compensation of the 
form seen in Eq. (5.29). If two points on a log scale lie at o; and kw, midway 
between them is at J ko 1. Thus we see that the maximum phase lead 
occurs at 


l 

JaT 
For example, a lead compensator with a zero at s = 2 (T = 0.5) and a pole 
at s = 10 (aT = 0.1) would yield the maximum phase lead at s = 4.47. The 
amount of phase lead at the midpoint depends only on ao and is plotted in Fig. 
5.47. It shows that a designer can achieve increasing phase lead with higher values 
of l/a, sometimes referred to as the /ead ratio; however, Fig. 5.46 shows that 
increasing values of 1/a also produce greater amplifications at higher frequencies. 
Thus the designer's task is to select a value of l/a that is a good compromise 
between acceptable phase margin and noise sensitivity at high frequencies. 

Even if a system had negligible amounts of noise present and the pure deriva- 
tive compensation of Eq. (5.28) were acceptable, the actual compensation would 
look more like Eq. (5.29) than Eq. (5.28) because of the impossibility of building 
a pure differentiator. No physical system, mechanical or electrical, responds with 
anything like infinite amplitude at infinite frequencies and there will be a limit 
in the frequency range (or bandwidth) for which derivative information (or phase 
lead) can be provided. 


(5.30) 
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FIGURE 5.47 
Maximum phase increase 
for lead compensation. 


EXAMPLE 5.10 
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As an example of design using frequency response, let's repeat the design of 
compensation for 


1 
S = s(s + 1) 


that was carried out in Section 4.5. This time we wish to obtain a steady-state error 
of less than 0.1 for a unit ramp input. Furthermore, we desire an overshoot (M p) 
of less than 25%. 

The steady-state error is given by 


| R(s), 


| 
d a | 1 + D(s)G(s) 


where R(s) = 1/s? for a unit ramp, which reduces to 


| l "E 
SES imf s + DOs + i ~ DO)’ 


Therefore we find that D(0), the steady-state gain of the compensation, must not 
be less than 10 to meet the error criterion. So let’s pick K = 10 in Eq. (5.29). To 
relate the overshoot requirement to phase margin, Fig. 5.33 shows that a PM of 45° 
should suffice. The frequency response of K G(s) in Fig. 5.48(a) shows that a PM of 
20° results if no phase lead is added by compensation. If it were possible to simply 
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FIGURE 5.48 
Example of lead-compensation design: (a) frequency response. 
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FIGURE 5.48 (cont. ) 
Example of lead- 


compensation design: 


(b) root locus. 


Im(s) 


Dis)\= K k5/2*1 
s/10+1 


Re(s) 


(b) 


add phase without affecting the magnitude, we would only need an additional 25° 
phase at the K G(s) crossover frequency of w = 3 rad/s. However, maintaining the 
same low-frequency gain and adding a compensator zero will increase the crossover 
frequency, and hence more than 25° will be required from the lead network. So to 
be safe, let’s design the lead compensator so that it supplies a maximum phase lead 
of 40°. Fig. 5.47 shows that 1/a = 5 will accomplish that goal. With some trial 
and error, it can be found that placing the zero at w = 2 rad/s, thus causing the pole 
to be at w = 10 rad/s, results in the maximum phase lead from the compensator 
to occur at the magnitude | crossover frequency and maximizes the benefit of the 
compensation. The compensation, therefore, is 


(s/2) + 1 
hs) = ARQ) + T" 
The frequency-response characteristics of D(s)G(s) in Fig. 5.48 can be seen to 
yield a phase margin of 45°, which satisfies the design goals. Recall that the root 
locus for this design was drawn in Fig. 4.15(b). The figure is repeated as Fig. 
5.48(b) with the root locations for K = 10 marked and it verifies that this choice 
of compensation parameters yields the desired damping ratio. I 
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A summary of the design procedure for Example 5.10 is: (1) determine the low- 
frequency gain so that the steady-state errors are within specification, and (2) select 
the combination of lead ratio 1/a and zero location that achieves an acceptable PM 
at crossover. This design procedure will apply to many cases; however, the designer 
should keep in mind that the specific procedure followed in any particular design 
may need to be tailored to its particular set of specifications. 

In the design example, there were two specifications: peak overshoot and 
steady-state error. We transformed the overshoot specification to PM in order to 
use it directly in the frequency-response design. The steady-state error specification 
was usable directly. No speed-of-response type of specification was given; however, 
it would have impacted the design in the same way that the steady-state error 
specification did. The speed of response or bandwidth of a system is directly 
related to the crossover frequency as was pointed out in Section 5.8. Fig. 5.48(a) 
shows that the crossover frequency is 3 rad/s and could have been increased by 
raising the gain K and increasing the frequency of the lead compensator pole and 
zero in order to keep the slope = —1 at the crossover frequency. Raising the 
gain would also have had the effect of decreasing the steady-state error so that it 
was less than the specified limit. The gain margin was never introduced into the 
problem because the stability was adequately specified by the phase margin alone. 
Furthermore, the gain margin is not useful for this system because the phase never 
crosses the — 180? line and the GM is always infinite. 


5.9.3 PI Compensation 


Let's now turn to a discussion of the design of proportional-plus-integral control 
via its frequency response. It has a transfer function of 


D(s) — P *z 
S 


T, (SaD 


which results in the frequency-response characteristics shown in Fig. 5.49. The 
desirable aspect of this compensation is the infinite gain at zero frequency, which 
causes the steady-state error in many cases to vanish. This is accomplished, how- 
ever, at the cost of a phase decrease below the breakpoint at o = 1/T;. Therefore 
1/T; is usually located at a frequency substantially less than the crossover frequency 
so that the system phase margin is not affected very much. 


5.9.4 Lag Compensation 


Another similar compensation, an approximation to proportional-plus-integral, is 
called lag compensation. Its transfer function is 


Ts +1 


D = K —__., 
i aTs +1 


(5.32) 
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FIGURE 5.49 

Frequency response of 
proportional-plus-integral 
control. 
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where a > 1. Although this looks identical to the lead compensation in Eq. 
(5.29), the fact that œ > 1 causes the pole to have a lower breakpoint frequency 
than the zero, thus producing the low-frequency increase in amplitude and phase 
decrease (lag) apparent in the frequency-response plot in Fig. 5.50 and giving the 
compensation the essential feature of integral control: a high low-frequency gain. 
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FIGURE 5.50 
Frequency response of 
lag compensation with 
a = 10. 


EXAMPLE 5.11 Now let's repeat the same design example once more using lag compensation. The 
frequency response of the system KG(s), with the required steady-state gain of 
K = 10, is shown in Fig. 5.51. The designer’s task is to select the lag compensa- 
tion breakpoints so that the crossover frequency is lowered and a more favorable 
phase margin results. To prevent detrimental effects from the compensation phase 
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FIGURE 5.51 
Frequency-response 
example of lag- 
compensation design. 
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lag, the pole and zero of the compensation need to be substantially lower than the 
new crossover frequency. One possible choice is shown in Fig. 5.51: The lag zero 
is at 0.1 rad/s and the lag pole is at 0.01 rad/s. This selection of parameters pro- 
duces a phase margin of 50°, thus satisfying the specifications. It can be seen from 
this example that the stabilization is achieved by lowering the crossover frequency 
to a region where G(s) had more favorable phase characteristics. Furthermore, the 
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reduction in the crossover frequency is dependent on the ratio (a) of the compensa- 
tion zero breakpoint to the pole breakpoint and not on the absolute location of the 
pole and zero. The criterion for the pole and zero location selection is to make it 
low enough to minimize the effects of the phase lag from the compensation at the 
crossover frequency. Generally, however, the pole and zero are located no lower 
than necessary because the additional system root (see the root locus of a similar 
system design in Fig. 4.17(b) introduced by the lag will be in the same frequency 
range as the compensation zero and will have some effect on the output. g 


One can interpret the beneficial effects of lag compensation in two ways: It 
reduces high-frequency gain for better phase margin, or it increases low-frequency 
gain for better error characteristics. The example design shown in Fig. 5.51 was 
illustrative of the first interpretation. However, given the same system with propor- 
tional feedback K — 1 so that the uncompensated frequency-response magnitude 
would fall on the dashed line in Fig. 5.51 for œw = 0.5 rad/s, and told to meet 
the error specifications while preserving stability and bandwidth, a designer could 
accomplish the task by introducing the lag compensation shown in Fig. 5.51. This 
would simply increase the low-frequency gain by a factor of 10 with essentially no 
change in gain or phase at crossover. Thus we have an illustration of the second 
interpretation. 

The last two design examples (shown in Figs. 5.48 and 5.51) meet an identical 
set of specifications for the same plant in very different ways. In the first case the 
specifications are met through the use of a lead network; a crossover frequency 
of 5 rad/s (wgw = 6 rad/s) results. In the second case the same specifications are 
met through the use of a lag network, and a crossover frequency of approximately 
0.8 rad/s (wgw = 1 rad/s) results. If there was a rise-time or bandwidth specifica- 
tion, the choice of compensation might have been influenced by that specification; 
however, in this particularly simple example, any bandwidth or steady-state error 
specification could be met by simply raising the gain sufficiently high using either 
type of compensation. 

In more realistic systems, typically there are dynamic elements representing 
the actuator and sensor as well as the system itself, and it is typically impossible 
to raise the crossover frequency much beyond the value that represents the speed 
of response of the components being used. Although linear analysis seems to 
suggest that almost any system can be "compensated," in fact, if one attempts to 
drive a set of components much faster than their natural frequency, there will be 
saturations in the system, the linearity assumptions are no longer valid, and the 
linear design represents little more than wishful thinking. With this background, 
we see that to simply increase the gain of a system with a lead compensator may 
not always be feasible. In this case, use of the lag compensator to increase the 
low-frequency gain while holding the crossover frequency constant may be the 
only viable option. 
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FIGURE 5.52 
Frequency response of PID with T;/Tp = 20. 
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EXAMPLE 5.12 


FIGURE 5.53 
PID design example. 
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5.9.5 PID Compensation 


By combining the derivative and integral feedback, Eqs. (5.28) and (5.31), we 
obtain PID control. Its transfer function is 


l 
+ — 


K 
D(s) = — 
(s) : T, 


(Tps + 1) | (5,33) 


and its frequency-response characteristics are shown in Fig. 5.52. This form is 
slightly different than that given by Eq. (3.16); however, the effect of the difference 
is inconsequential. This compensation is roughly equivalent to using both a lead 
and a lag compensator, sometimes referred to as a lead-lag compensator. 


As an example of PID compensation design using frequency-response methods, 
consider the spacecraft attitude-control problem. A simplified design was presented 
in Section 5.7; however, here we have a more realistic situation that includes a 
sensor lag and a disturbing torque. Figure 5.53 defines the system. The design 
specifications are to have zero steady-state error, a phase margin of 65?, and as 
high a bandwidth as is reasonably possible, all using a PID controller. 

First, let's take care of the steady-state error. For the spacecraft to be at a 
steady final value, the total input torque, Tz + Te, must equal zero. Therefore if 
Ta is nonzero, T, must equal —T4. The only way this can be true with no error 
(e = O0) is for D(s) to contain an integral term, hence the necessity for the “I” in 
PID. This could also be verified mathematically by use of the final-value theorem 
(see Problem 5.35). 
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The frequency response of the spacecraft and sensor, 


ca (5.34) 


sys $* $4 2' 


is shown in Fig. 5.54. The —2 (that is, —40 dB per decade) and —3 (—60 dB per 
decade) slopes show that the system would be unstable for any K if no derivative 
feedback were used. Therefore the “D” in PID is required to bring the slope to 
— 1 (—20 dB per decade) at the crossover frequency, and the problem now is to pick 
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the three parameters in Eq. (5.33) — K, Tp, and T; —so that the specifications are 
satisfied. 

The easiest approach is to work first on the phase so that a 65? PM is achieved 
at a reasonably high frequency. This can be accomplished primarily by adjusting 
Tp, although T; has a minor effect if sufficiently larger than Tp. Once the phase 
is adjusted, the crossover frequency is established and the gain K is easily deter- 
mined. 

By examining the phase of the PID in Fig. 5.52, we can consider what would 
happen to the compensated spacecraft system, D(s)G(s), as Tp is varied. If 1/Tp = 
2 rad/s, the phase lead from the PID would simply cancel the sensor phase lag 
and the composite phase would never exceed — 180°, an unacceptable situation. If 
1/Tp = 0.01, the composite phase would approach —90° for a range of frequencies 
and would exceed —115° (potentially providing a PM of 65°) for an even wider 
range of frequencies. The compensated phase curve shown in Fig. 5.54 has 1/Tp = 
0.1, which is the largest value of 1/Tp that could provide the required PM of 65°. 
The phase would never cross the —115? (65° PM) line for any 1/Tp > 0.1. For 
l/Tp = 0.1, the crossover frequency w, that produces the 65° PM is 0.5 rad/s. 
For a value of 1/Tp < 0.05, the phase essentially follows the dotted curve in Fig. 
5.54, which indicates that the maximum possible w, is approximately 1 rad/s and is 
provided by 1/Tp = 0.05. Therefore 0.05 < 1/Tp < 0.1 is the only sensible range 
for 1/Tp; anything less than 0.05 provides no significant increase in bandwidth, 
anything more than 0.1 could not meet the PM specification. Although the final 
choice is somewhat arbitrary, we have chosen 1/Tp = 0.1 for our final design. 

Our choice for 1/7; is a factor of 20 lower than 1/Tp; that is, 1/7; = 0.005. 
The factor of 20 was selected because anything less than 20 would have negatively 
impacted the phase at crossover, thus lowering the PM. Furthermore, it is generally 
desirable to maintain the compensated magnitude as large as possible at frequencies 
below «, because that provides a faster transient response and smaller errors. In 
order to bring this about, it is desirable to maintain l/Tp and l/T; at the highest 
possible frequencies, hence the rationale for selecting the values of 1/Tp and 1/Tj. 

Determination of K is the only remaining task. Unlike the previous example 
where K was selected in order to meet a steady-state error specification, here we 
select K in order to yield a crossover frequency at the point where we have carefully 
tailored the phase to yield the required 65? PM. The basic idea for finding K was 
discussed in Section 5.6 and consists of plotting the compensated system amplitude 
with K = 1, finding its value at crossover, then setting 1/K equal to that value. 
This is done in Fig. 5.54 and shows that when K — 1, |D(s)G(s)| — 20 at the 
desired crossover frequency of 0.5 rad/s. Therefore 


l 
K 


= 20, 


and 
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5.10 


The compensation that satisfies all of the specifications is now complete: 
0.05 
D(s) — —. (00s + 1)(s + 0.005)]. 


It is interesting to note that this system would become unstable if the gain 
were lowered so that the crossover frequency became less than w = 0.02 rad/s, 
the region in Fig. 5.54 where the phase of the compensated system is less than 
— 180°. This situation is referred to as a conditionally stable system. A root locus 
versus K for this and any conditionally stable system would show the portion of 
the locus corresponding to very low gains to be in the RHP. 8 


5.9.6 Summary of Compensation Characteristics 


PD control adds phase lead at all frequencies above the breakpoint. If no change 
in gain of low-frequency asymptote, PD compensation will increase crossover fre- 
quency and speed of response. Increasing frequency-response magnitude at the 
higher frequencies will increase sensitivity to noise. 

Lead compensation adds phase lead at a frequency band between the two 
breakpoints, which are usually selected to bracket the crossover frequency. If no 
change in gain of low-frequency asymptote, lead compensation will increase the 
crossover frequency and speed of response over the uncompensated system. If gain 
of low-frequency asymptote is reduced in order not to increase crossover frequency, 
the steady-state errors of the system will increase. 

PI control increases frequency-response magnitude at frequencies below the 
breakpoint thereby decreasing steady-state errors. It also contributes phase lag be- 
low the breakpoint, which must be kept at a low enough frequency so that it does 
not degrade stability excessively. 

Lag compensation increases frequency-response magnitude at frequencies be- 
low the two breakpoints thereby decreasing steady-state errors. With suitable ad- 
justments in loop gain, it can alternatively be used to decrease the frequency- 
response magnitude at frequencies above the two breakpoints so that the magnitude 
| crossover occurs at a frequency that yields an acceptable phase margin. It also con- 
tributes phase lag between the two breakpoints, which must be kept at low enough 
frequencies so that the phase decrease does not degrade stability excessively. 


Alternative Presentation of Data 


Other presentations of frequency-response data have been developed over the years 
to aid both in understanding design and in easing the designer's work load. 


EXAMPLE 5.13 


5.10 / Alternative Presentation of Data 313 


Nichols Chart 
A plot of |G(j@)| versus ZG(j«) can be drawn by simply transferring the in- 
formation directly from the separate magnitude and phase Bode plots: One point 
on the new curve thus results from a given value of frequency w. The magnitude 
information is plotted on a log scale while the phase information is plotted with a 
linear scale, just as was the case with the Bode plots. This template was suggested 
by N. Nichols* and is usually referred to as a Nichols chart. The idea of plotting 
the magnitude versus phase of G(jw) is similar to the plotting of the real and 
imaginary parts of G(j«) that was the basis for the Nyquist plots shown in Sec- 
tions 5.5 and 5.6. However, it is difficult to capture all the pertinent characteristics 
of G( jc) on the linear scale of the Nyquist plot. The log scale for magnitude in 
the Nichols chart alleviates this difficulty and allows this kind of presentation to 
be used for design. 

For any value of the complex transfer function G( jw), Section 5.8 shows that 
there is a unique mapping to the unity feedback, closed-loop transfer function 


G(jo) 
ELS TS 
The Nichols chart also contains contours of constant closed-loop magnitude and 
phase based on this relationship, as shown in Fig. 5.55. A designer can, there- 
fore, graphically determine the bandwidth of a closed-loop unity-feedback system 
from the plot of the open-loop data on a Nichols chart by noting where the curve 
crosses the 0.7 (-3dB) contour of the closed-loop magnitude and determining the 
frequency of the corresponding data point. Likewise, a designer can determine 
the resonant-peak amplitude M, by noting the value of the highest closed-loop 
magnitude contour that is tangent to the curve. The frequency associated with the 
magnitude and phase at the point of tangency is sometimes referred to as the res- 
onant frequency w,. Similarly, a designer can determine the GM by observing the 
value of gain where the Nichols plot crosses the — 180? line and can determine the 
PM by observing the phase where the plot crosses the amplitude 1 line. 


To illustrate, the compensated design example seen in Fig. 5.54 is shown in a 
Nichols chart in Fig. 5.56. In comparing the two figures, it is important to divide 
the magnitudes in Fig. 5.54 by a factor of 20 so that |D(s)G(s)| is obtained, rather 
than the normalized values used in Fig. 5.54. Since the curve crosses the closed- 
loop magnitude contour of 0.7 at w = 0.7 rad/s, we see that the bandwidth of this 
system is 0.7 rad/s. Since the largest magnitude contour touched by the curve is 
1.2, we also see that the resonant peak M, is 1.2. B 


* James, Nichols, & Philips (1947). 
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FIGURE 5.55 
Nichols chart. 
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It can be proven that the contours of constant closed-loop magnitude and phase 
are circles when G( jo) is presented in the Nyquist plot. These circles are referred 
to as the M and N circles, respectively. 

This presentation of data was particularly valuable when a designer generated 
plots and performed calculations by hand. A change in gain, for example, could 
be evaluated by sliding the curve vertically on transparent paper over a standard 
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Nichols chart. The GM, PM, and bandwidth were then seen easily from the chart, 
thus allowing evaluations of several values of gain with a minimal amount of effort. 
For designers with access to computer-aids, however, calculations of bandwidth 
and many repetitive evaluations of gain or any other parameter are quickly accom- 
plished with a few keystrokes. The primary value of the Nichols chart today is as 
an alternate presentation of the information in a Nyquist plot. For complex systems 
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where the —1 encirclements need to be evaluated, the magnitude log scale of the 
Nichols presentation enables examination of a wider range of frequencies than a 
Nyquist plot and enables the designer to read the gain and phase margins directly. 


EXAMPLE 5.14 Figure 5.57 shows a Nichols chart with the data from the same case whose Nyquist 


plot is shown in Fig. 5.35. Note that the phase margin for both crossover frequen- 
cies is seen to be 36° and the gain margin is seen to be 1.25 (= 1/0.8). It is clear 


FIGURE 5.57 
Nichols chart of the complex system whose Nyquist plot is in Fig. 5.35. 
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FIGURE 5.58 
Inverse Nyquist plot for 
Example 5.5. 
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from this presentation of the data that the most critical portion of the curve is seen 
as it crosses the 180° line; hence the GM is the most relevant stability margin in 
this example. i 


Inverse Nyquist 
This plot is simply the reciprocal of the complex quantity in the Nyquist plot 
described in Section 5.5 and used in Section 5.6 for the definition and discussion 
of stability margins. It is obtained most easily by computing the reciprocal of the 
magnitude from the Bode plot and plotting that quantity at an angle in the complex 
plane, which is the negative of the phase from the Bode plot. It can be used to 
find the PM and GM in the same way that the Nyquist plot was used. When 
|G(jw)| = 1, |G~'(jw)| = 1 also, so the PM is measured from the negative real 
axis, but positive upward due to the phase sign reversal. However, when the phase 
= —180° or +180°, the value of |G~'(jw)| is the GM directly; no calculation of 
an inverse is required as was the case for the Nyquist plot. 

The inverse Nyquist plot of Example 5.5 from Section 5.5 defined in Fig. 5.20 
is shown in Fig. 5.58 for the case where the gain is low and the system is stable. 
Note that the GM = 2 and the PM = 20°. As an example of a more complex case, 
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FIGURE 5.59 
Inverse Nyquist plot 
of the system whose 
Nyquist plot is in 
Fig. 5.35. 


9.11 


Fig. 5.59 shows an inverse Nyquist plot for the sixth-order case whose Nyquist 
plot was shown in Fig. 5.35 and whose Nichols chart is shown in Fig 5.57. Note 
here that the GM = 1.2 and the PM = 35°. Had the two crossings of the unit 
circle not occurred at the same point, the crossing with the smallest PM would 
have been the appropriate one to use. 


Sensitivity 


In this section we will develop conditions on the Bode plot of the open-loop transfer 
function DG to ensure good performance with respect to sensitivity, steady-state er- 
rors, and sensor noise. One of the justifications for feedback, developed in Chapter 
3, is to reduce the effect of disturbances and parameter changes on the performance 
of a control system. One aspect of the sensitivity issue has been the consideration 
of steady-state errors due to command inputs and disturbances. This has been 
an important design component in the different design methods. Design for ac- 
ceptable steady-state errors can be thought of as the placement of a lower bound 
on the very low-frequency gain of the system. Another aspect of the sensitivity 
issue concerns the high-frequency portion of the system. So far, Chapter 3 and 
Sections 4.5 and 5.9 have briefly discussed the idea that alleviation of the effects 


FIGURE 5.60 
Effect of high-frequency 
plant uncertainty. 
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of sensor noise dictate that the gain of the system at high frequencies be kept low. 
In fact, in the development of lead compensation, we placed an extra pole in the 
system specifically to reduce effects of sensor noise at the higher frequencies. It is 
not unusual for designers to place extra poles in the compensation, that is, to use 


Isti 
o = late +19 
so that even more attenuation is introduced for noise reduction. 

Yet another consideration affecting high-frequency gains is that many systems 
have high-frequency dynamic phenomena such as mechanical resonances that can 
sometimes impact the stability of a system. In very high performance designs, 
these high-frequency dynamics are included in the plant model, and a compensator 
is designed with a specific knowledge of those dynamics. A standard approach 
to designing for unknown high-frequency dynamics is to keep the high-frequency 
gain low, just as we did for sensor-noise reduction. The reason for this can be 
seen from the gain versus frequency of a typical system, shown in Fig. 5.60. The 
only way instability can result from high-frequency dynamics is if an unknown 
high-frequency resonance causes the magnitude to rise above 1. Conversely, if all 


High frequency 


| Dis) G(s) | 
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FIGURE 5.61 
Design criteria for low 
sensitivity. 


unknown high-frequency phenomena are guaranteed to remain below a magnitude 
of 1, stability can be guaranteed. The likelihood of an unknown resonance in the 
plant, G, rising above | can be reduced if the nominal high-frequency gain of DG 
is lowered by the addition of extra poles in D. When the stability of a system with 
resonances is ensured by tailoring the high-frequency magnitude so that it never 
exceeds 1, we refer to this process as amplitude stabilization. Of course, if the 
resonance characteristics are known exactly, a specially tailored compensation such 
as one with a notch at the resonant frequency can be used to reduce the gain at a 
specific frequency. This method of stabilization is referred to as phase stabilization. 
A drawback to phase stabilization is that the resonance information is often not 
available with adequate precision and therefore the method is more susceptible 
to errors in the plant model used in the design. Thus we see that sensitivity to 
plant uncertainty and sensor noise are both reduced by sufficiently low gain at high 
frequencies. 


Magnitude of D(s) G(s) 


FIGURE 5.62 
Feedback control system. 
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These two aspects of sensitivity —high- and low-frequency behavior—can be 
depicted graphically, as shown in Fig. 5.61. There is a minimum low-frequency 
gain allowable for acceptable steady-state error performance and a maximum high- 
frequency gain allowable for acceptable noise performance and for low probability 
of instabilities caused by plant-modeling errors. Between these two bounds the 
control engineer must achieve a gain crossover near the required bandwidth, which 
as we have seen, must be done at essentially a slope of —1. 


5.11.1 Sensitivity Function 


In order to aid the designer in making a control system as insensitive as possible, 
special functions have been defined that exhibit the sensitivity of a closed-loop 
control system. We will initially define the functions for the SISO systems that 
are the subject of this text and then discuss briefly how they are extended to 
MIMO cases where they are used extensively in the design of insensitive or robust 
compensation. 

Consider the unity feedback system in Fig. 5.62 with the plant G and the 
compensator D. One of the main objectives of the control system is to keep the 
tracking error (e = r — y) small for a reference input excitation and to keep 
the output (y) small for a disturbance input (d). The measurement noise is repre- 
sented by n. From the block diagram we may write, 


ywd--GGbir-—»-n) (5.35) 
(1 - GD)y = d * GD(r — n) (5.36) 

or 
y = (1+ GD) 'd + (1 + GDY !GD(r — n) (5.37) 


also for the tracking error we have, 
e = r — (d + GDe) - GDn 
(1 + GD)e = r — d + GDn (5.38) 


or 


e = (1+ GDY !(r d) + (1 + GDY 'GDn (5.39) 
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The sensitivity function is defined as, 
S(s) = (1 + GD)! (5.40) 


which Eq. (5.37) shows is the transfer function from d to y. We also see from Eq. 
(5.39) that S is the transfer function from d to —e. 
The complementary sensitivity function is defined as,* 


T(s) = (1+GD)'GD (5.41) 


and is the transfer function between the reference input r and the output y, that 
is, it is the closed-loop system transfer function. With some manipulation, the 
complementary sensitivity function can also be expressed as 


T(s) = [1 + (GD) '] ! (5.42) 
and the sum of the two sensitivity functions shown to obey 
S(s) + T(s) = 1. (5.43) 
Therefore, with n = 0, we may then write Eq. (5.37) as 
y =Sd+Tr (5.44) 
and (5.39) as 
e = S(r — d). (5.45) 


Eq. (5.43) states that regardless of the compensation used, the sum of the sensitivity 
and the complementary sensitivity will always be unity. 

The sensitivity function $ is then the primary measure of performance so far 
as it relates to tracking performance (making e small for a given r) and also to 
disturbance rejection (making y small for a given d ). Thus it is important to make 
S(s) small in some sense. For physically realizable systems, the /oop gain 


L = |GD| (5.46) 
must become small for high frequencies. This means that 


lim S(s) = 1. (5.47) 


Therefore it is only possible to make the sensitivity function small over low and 
midrange frequencies but not at very high frequencies. Figure 5.63(a) shows a 
typical plot of the sensitivity function S. The function is small at low frequencies, 
which is as desired for good tracking and disturbance rejection. At the midrange 
frequency, it approaches unity and crosses it before approaching unity again for 
high frequencies. 


* The symbol T for the complementary sensitivity function is traditional, as is its use for the breakpoint 
in the lead and lag compensators discussed in Section 5.9. These two items are unrelated and the 
meaning of the symbol should be clear from the context. 
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FIGURE 5.63 


Typical plots of (a) sensitivity function and (b) complementary sensitivity function. 
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At the same time, we ideally wish to make the complementary sensitivity 
function one at all frequencies. However, this is not physically possible as 


lim T(s) = 0. (5.48) 


Therefore it is only possible to make T(s) close to unity at low and midrange 
frequencies, but the complementary sensitivity function must roll off at high fre- 
quencies as suggested by Eq. (5.43). Figure 5.63(b) shows a typical plot of the 
complementary sensitivity function. It is unity at low and midrange frequencies but 
rolls off where S(s) approaches one. 

The transfer function from the measurement noise n to the output y is, from 
Eq. (5.37) with d = r = 0, 


y = —(1 + GD) !GDn. (5.49) 


Therefore, we also see that the complementary sensitivity function 


T(s) = = = (1+ GD)'GD. (5.50) 
We would like to make this transfer function as small as possible. This brings out 
the classical tradeoff in feedback control: Good tracking and disturbance rejection 
(S small and T large) must be balanced against minimization of the effect of sensor 
noise (S large and T small). 
The complementary sensitivity function T(s) also plays a key role in determin- 
ing the stability properties of the system. Consider the Nyquist plot in Fig. 5.64 
showing the phase and gain margins that were defined in Section 5.6. The sensitiv- 
ity function is related to these margins because Eq. (5.40) shows that it represents 
the inverse of the distance from G(jw)D(jw) to the —1 point. For convenience, 
we define a to be the distance from G(jw)D(jw) to the —1 point. Therefore, 


l l 


Qmin ^ —————4 = min ——. (5.51) 
max IS(jo)| e |S(jw)| 


Note that oi, is the radius of the circle with the center at — 1 and tangent to 
the Nyquist plot as shown in Fig. 5.64. As noted in Section 5.10, this is sometimes 
referred to as an M circle. Note also that it is the same quantity that Smith (1958) 
referred to as the vector margin. 

From Fig. 5.64, we see that 


GM = — — (5.52) 
and 


PM = 2 arcsin( =) (5.53) 


FIGURE 5.64 
Nyquist plot showing 
stability margins. 
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Re(DG) 


[1+ D(jo)GCjo)] 


and, because a; and o? must both be greater than ay jn, we see that the maximum 
value of the sensitivity function yields information about the phase and gain mar- 
gins. One could use @min in Eqs. (5.52) and (5.53) to yield conservative estimates 
of PM and GM. 

In the MIMO case, the sensitivity function is defined as in Eq. (5.40), ex- 
cept GD becomes the matrix of transfer functions between the inputs and the 
outputs, and the value 1 is replaced with the identity matrix. Furthermore, rather 
than maximizing the sensitivity function as in Eq. (5.51), we judge stability by 
defining 


1 


l 
min — i a on Ait EL 5.54 
Sain = Go Bolle nom 


where @(.) and ||.||; denote the maximum singular value and the infinity norm, 
respectively (see Appendix C). For the SISO case, these quantities reduce to the 
definitions in Eq. (5.51). The definition of the sensitivity functions and the exten- 
sions of stability ideas based on these functions to the MIMO case may be done 
in terms of the recent H” control theory. 

The complementary sensitivity function also may be related to the phase and 
gain margins. Consider the inverse Nyquist plot shown in Fig. 5.65. From Eq. 
(5.42) it is apparent that T( jc) is the reciprocal of the distance between the —1 
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FIGURE 5.65 
Inverse Nyquist plot 
showing stability 
margins. 


WT 


‘SJ 


[DC jo)G(jo)]- 


EON 


Re(GD)! 


[1-- (DG9)G(CJo))!] 


point and (GD) !. We can therefore define 


l i l 1 l 
min 


Brmin = 


max|T(je)| - 
The gain margin is 
GM = 1+ Bis 


and the phase margin is 


PM = 2 arcsin Pee) 


TGja| © aTGo) TGO 


(5.55) 


(5.56) 


(5.57) 


Note that Bmin is the radius of the circle with center at —1 and tangent to the 
inverse Nyquist plot, that is, it defines the minimum distance from the — 1 point. 


The quantity Bmin is sometimes referred to as the complex margin. 


Use of Bmin to compute the GM and PM will obviously yield conservative 
estimates. The GM estimate will be exact only if the vector defining the minimum 
distance lies along the negative real axis. Likewise, the PM estimate will be exact 
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only if the vector defining the minimum distance coincides with the point where 
GD crosses the unit circle. 

The phase and gain margin estimates discussed in this section are attractive in 
the study of MIMO systems because they provide familiar measures (PM and GM) 
of the system’s stability. The phase- and gain-margin estimates can be computed 
based on both the sensitivity and complementary sensitivity functions and the least 
conservative answer selected. 


5.11.2 Stability Robustness 


Most control system designs are based on a model of the plant; however, it is 
inevitable that the model we use is only an approximation of the true system dy- 
namics. The difference between the model on which the design is based and the 
true system used in the actual control is referred to generally as model uncertainty. 
If the design performs well for substantial variations in the dynamics of the plant 
from the design values, we say the design is robust. We turn now to consider the 
effect of model uncertainty on the stability of control systems. Typical sources 
of uncertainty include unmodeled (high-frequency) dynamics, neglected nonlinear- 
ities, effects of deliberate reduced-order modeling, and plant-parameter changes 
due to environmental factors such as temperature, air speed, and age. Uncertainty 
can be represented in the form of either additive or multiplicative perturbation, as 
shown in Fig. 5.66. For the multiplicative case of Fig. 5.66(b), the true transfer 
function is 


G(s) = Go(s, A[1 + /(s)], 


where Go(s, 0) is a parameterized model of the plant with structured uncertainty 
0, which represents the plant-parameter variations. The expression Go(s, 0) is a 
known function (known structure), but the values of the parameters 0 are uncertain. 
The function /(s) is an unstructured uncertainty and is entirely unknown, except 
that it is limited in magnitude by some function of frequency as 


IL(jo)| = low), (5.58) 


where lo(w) is a known, real scalar function. The bound can be viewed as a 
frequency-dependent “radius” of uncertainty of the true plant G(s) about some 
model Go(s, 0) for a given 0. Figure 5.67 shows how such a bound can be 
calculated experimentally by simply comparing the actual plant with the model. 
In general, a good model will be well known at low frequencies, resulting in 
small /(w) for œw < w, and less well known at high frequencies where we 
have large /(w). The curve of Fig. 5.67 is characteristic of unstructured un- 
certainty. 
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FIGURE 5.66 
Representation of 
uncertainty: (a) additive 
perturbation and 

(b) multiplicative 
perturbation. 


FIGURE 5.67 
Frequency-dependent 
uncertainty bound. 
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FIGURE 5.68 
Compensated feedback 
system. 
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Compensation 
D(s) 


Let us now assume that all structured and unstructured uncertainties can be 
lumped into a stable multiplicative perturbation, that is, 


G(s) = Go(s)[1 + l(s)], (5.59) 


where Go(s) represents the nominal plant transfer function and /(s) is the model 
error. The system with compensation D(s) is as shown in Fig. 5.68, and the nominal 
closed-loop system [/(s) = 0] is designed to be stable.* A typical Nyquist plot of 
the compensated system is shown in Fig. 5.69. As Go(s) is perturbed toward G(s), 
the Nyquist plot moves around in an envelope, as shown in the figure. The system 
remains stable so long as the number of encirclements of —1 remains unchanged, 
which will be true if, for all possible values of l, 


|1 + D(jo)GCjo)| # 0, (5.60) 


that is, so long as the perturbed Nyquist plot does not pass through the —1 point. 
The above stability condition can be rewritten as 


1+ D(je)G«(je)0 -eD| #0 O<e<1 
0-5 v c, (5.61) 


which is true if and only if 
|1 + D(jo)Go(jo)(1 + €1)| > 0. (5.62) 
If we take out a factor of DGo, the open-loop gain, this can be expressed as 
IDGo [(DGo) ! + 1 + €l] | 7 0, (5.63) 
which is true if |DGo| # 0 and 
KDGo) ! - 1-7 el| » 0. (5.64) 


We would like to be able to express the requirement in terms of the open-loop 


*[D(s)G(s)|/[1 + D(s)G(s)] is stable. 
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Im(s) 


FIGURE 5.69 
Modification of Nyquist 
plot by model 
uncertainty. 


Re(s) 


r(o)- lo) | Go(w)| 


Perturbed 


Nominal 


gain of the nominal system DG». We can do this if we notice that, for e between 
0 and 1, 


KDGo) ! + 1 + el| > |1 + (DGo) !| - |I] > 0, (5.65) 
Or 
|1 + (DGo) ! | > |I]. (5.66) 


The system is then guaranteed to be stable so long as Eq. (5.66) is satisfied. We 
define the stability robustness measure as 


ôsr(w) = |1 + (DGo) |]. (5.67) 
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Then as long as the model uncertainty remains below dsp for all frequencies, the 
system is guaranteed to remain stable in spite of the perturbations /(s).* An al- 
ternative derivation of this result is possible using the “small-gain theorem" (see 
Problem 5.51). Note that dsp is simply the inverse of the closed-loop magni- 
tude frequency response, that is, the inverse of the complementary sensitivity 
function T(s). In terms of the complementary sensitivity function, we require 
that 


Ir(s) !| > | (5.68) 


or 


IT(s)| < 7 (5.69) 


for stability. This means that model uncertainty dictates an upper bound on the 
magnitude of T(s). The quantity / defines the minimum distance from the — 1 
point to the inverse Nyquist plot and, for the case where Eq. (5.69) is an equality, 
l would be the quantity Bmin as in Fig. 5.65. For high frequencies, Fig. 5.67 shows 
that |/(j@)| >> 1, therefore Eq. (5.68) suggests 


l 
IGD| < il (5.70) 


that is, the (multiplicative) modeling error defines an upper bound on the loop gain 
at high frequencies. 

The above discussion suggests the introduction of the following bounds on 
the sensitivity and complementary sensitivity functions depending on the tracking 
accuracy, bandwidth, and roll-off required:* 


IS| < |W," (5.71) 
IT| < |w;!|. (5.72) 


Figure 5.70 shows these bounds in terms of the open-loop gain and is essentially 
the same idea as that shown in Fig. 5.61 and used in the discussion at the beginning 
of this section to relate the ideas from compensation design to a magnitude Bode 
plot. 


*For the extension of this result, the MIMO case, see Doyle and Stein (1981). 


"These bounds are used in H * control theory as weightings on the sensitivity and complementary 
sensitivity functions to design compensation. 
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FIGURE 5.70 
Constraint boundaries 
on the open-loop gain 
(2, wy! >T) 


a 9.12 


| @D| 


Time Delay 


The Laplace transform of pure time delay is Gp(s) = e 5^ and was approximated 
by a rational function (Padé approximant) for root locus analysis. Although this 
same approximation could be used with frequency-response methods, an exact 
analysis of the delay is quite straightforward. 

The frequency response of the delay is given by the magnitude and phase of 
e 5T |, — jo. The magnitude is 


IGp(jo)| = Je 7*"| = |coswT — jsineT| 2 1 forall c. 


This result is expected, since a time delay merely shifts the signal in time and has 
no effect on its magnitude. The phase is 


ZGp(jo) = —oT radians, 


and it grows increasingly negative in proportion to the frequency. This, too, is 
expected since a fixed time delay T becomes a larger fraction or multiple of a 
sine-wave period as the period drops because of the increasing frequency. A plot of 
Z Gp( jo) is drawn in Fig. 5.71 and shows how the phase lag is greater than 270° 
for values of wT greater than about 5 rad. This implies that it would be virtually 


FIGURE 5.71 


Phase lag due to pure 


time delay. 


o 9.13 
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impossible to stabilize a system (or to achieve a positive PM) with a crossover 
frequency greater than w = 5/T, and it is typically difficult to achieve bandwidths 
greater than « = 3/T. These characteristics essentially place a constraint on the 
achievable bandwidth of any system with a time delay. See Problem 5.52 for an 
illustration of the constraint. 


Obtaining a Pole-Zero Model from Frequency-Response Data 


As has been pointed out earlier, it is relatively easy to obtain the frequency response 
of a system experimentally. Sometimes it is desirable to obtain an approximate 
model, in terms of a transfer function, directly from the frequency response. The 
derivation of such a model can be done to various degrees of accuracy. The method 
described below is usually adequate and is widely used in practice. 

To obtain a model from frequency-response data there are two choices. In 
the first case, one can introduce a sinusoidal input, measure the gain and the 
phase difference between output and input, and accept the curves plotted from this 
data as the model. Using the methods given in previous sections, the design can 
be done directly from this information. If we wish to use the frequency data to 
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FIGURE 5.72 


An experimental frequency response. 
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verify a mathematical model obtained by other means, then we need to extract an 
approximate transfer function from the plots. The method suggested is to fit straight 
lines to the data, estimate breakpoints (find the poles and zeros), and project the 
damping ratios of complex factors by the frequency overshoot or the phase, as 
found from Fig. 5.5. One systematic procedure is to begin at the highest frequency 
of interest and fit a first or second order term, subtract this from the data, move to 
a lower frequency on the residual, and repeat. 


For example, consider the frequency response plotted in Fig. 5.72. Drawing an 
asymptote to the final slope of —2 or —40 dB per decade, we assume a break 
at the frequency where the phase is —90?, which occurs at f, = 1.66, or w; = 
2T f| = 10.4 rad/s. We need to know the damping ratio to be able to subtract 
out this second-order pole. Actually the phase curve may be more help. Since the 
phase around the break frequency is symmetric, we draw a line at the slope of 
the phase curve at f, to find that the phase asymptote intersects at fo = 0.71 Hz 
corresponding to f;/fo = 2.34, which in time corresponds to ¢ = 0.5, as seen 
on the normalized response curves in Fig. 5.5(b). The rest of the curve shows an 
asymptotic amplitude gain of about 6.0 dB, or a factor of 109979 = 2.0. Since 
this is a gain rise, it occurs because of a lead compensation of the form 


(s/z) + 1 
(s/p) - 1' 


where p/z = 2.0. If we remove the phase of the second-order terms, we obtain 
a phase curve with a maximum phase of about 20°, which also corresponds to a 
frequency separation of about 2. To locate the center of the lead network we must 
estimate the point of maximum phase on the lead term alone, which occurs at the 
geometric mean of the two break frequencies. This seems to occur at f2 = 0.3 Hz 
or w2 = 1.88 rad/s. Thus we have the relations 


zp = (1.88) = 3.55, 


E ws 
Z 
from which we can solve 
27? = 3,55, 
= 1.33, 
p = 2.66. 
Our final model is given by 
(s/1.33) + 1 


G(s) = (5.73) 


[(5/2.66) + 1][(s/10.4)* + (s/10.4) + 1] 
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The actual data was plotted from 


(s/2) + 1 


G(s) = [(s/4) + 1][(s/10)2 + (s/10) + 1] 


As can be seen, we found the second-order term quite easily, but the location of the 
lead network is off in center frequency by a factor of 4/2.66 = 1.5. However, the 
subtraction of the second-order term from the composite curve was not done with 
great accuracy, just by reading the curves. Again, as with the transient response, 
the conclusion is that by a bit of approximate plotting one can obtain a crude model 
(usually within +3 dB in amplitude and + 10° in phase) that can be used for control 
design. x 


Refinements on these techniques with computer aids are rather obvious, and 
an interactive program for removing standard first- and second-order terms and 
accurately plotting the residual would greatly improve the speed and accuracy of 
the process. It is also common to have computer tools that can find the parameters 
of an assumed model structure by minimizing the sum of squares of the difference 
between the model frequency response with the experimental frequency response. 


Summary 


A method of determining the stability of a closed-loop system based on the fre- 
quency response of the system's open-loop transfer function has been described. 
The degree of stability has been quantified in terms of a gain margin and phase 
margin, which can be determined directly by inspection from the magnitude and 
phase of the open-loop transfer function. The frequency-response characteristics of 
several types of compensation have been described, and examples of design using 
these characteristics have been discussed. They show the ease of selecting specific 
values of design variables, a result of using frequency-response methods. 

The advantages of design using frequency response have been shown to be the 
following: 


Numerical values of the design parameters that meet specifications are more 
readily determined than with root locus design. 
Experimental data of frequency response can be used directly. 


Tracking-error reduction and disturbance rejection can be specified in terms of 
low-frequency gain. 


Sensor noise rejection can be specified in terms of high-frequency attenuation. 


It develops an understanding that will be useful for design of multi-input 
multi-output control systems. 


Problems Section 5.2 


5.1 a) Show that a, in Eq. (5.1) is given by 


5.2 


5.3 


U, 
üt, = D) n 
S— Jo 
$7—Jo 
and 
U, 
a, = G(s) - 
s t Jo 


b) By assuming the output can be written as 
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l 
= -U,G(— jo)— 
2j 


1 
= U,G(jw)— 
2j 


s=+jw 


y(t) = aoe?” + abel 


derive the relations in Eqs. (5.3) and (5.4). 
a) Calculate the magnitude and phase of 


G(s) = 


1 


S+1 


for w = 0.1, 0.2, 0.5, 1, 2, 5, 10 rad/sec. 


b) Sketch the asymptotes for the G(s) in (a) and compare with your computed results 


from (a). 


Draw the Bode plot for the following systems. 


a) G(s) = EEEREN 
5 

~ (s+ DG + 10)? + 5s + 2500) ` 
4s(s + 10) 

(s + 50)(4s2 + 5s + A) 
10(s + 4) 

s(s + 1s? +25 + 5)" 
1000(s + 1) 

s(s + 2)(s? + 8s + 64)" 
(s + 5) 

s(s + 1s? +5 +4)’ 

E 4000 

s(s + 40). 


b) G(s) 


c) G(s) 


d) G(s) = 


e) G(s) = 


f) G(s) = 


g) G(s) 
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FIGURE 5.73 


5.4 


5.5 


100 
s(1+0.1s)(1 + 0.55). 


l 
s(1 + s)(1 + 0.02s) 


h) G(s) = 


i) G(s) = 


A certain system is represented by the asymptotic Bode plot shown in Fig. 5.73. Find 
and sketch the response of this system to a unit step input (zero initial conditions). 


Prove that a magnitude slope of —1 corresponds to —20 dB per decade. 


ES | 10 100 1000 
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5.6 


5.7 


5.8 


5.9 


Draw the Bode plots for a normalized second-order system with ¢ = 0.5 and an added 
zero. Do the plots lead one to expect extra peak overshoot in the transient response? 
How? 


(s/z) + 1 


due $2-sc-l 


Let z = a/2 and plot for a = 0.1, 1, and 10. 


Draw the Bode plot for a normalized second-order system with 4 = 0.5 and an added 
pole. Do the plots lead one to expect additional rise time? How? 


l 


al = [(s/p) + 1(s? + s + 0D): 


Let p = a/2 and plot fora = 0.1, 1, and 10. 


5 


For the closed-loop transfer function, F(s) = «7/(s? + 2¢w,s + w7), determine the 
ratio of the bandwidth wgw of F(s) tow, for ¢ = 0.2, 0.5, and 0.8. 


A DC voltmeter schematic is shown in Fig. 5.74. The pointer is damped so that its 
maximum peak overshoot to a step input is 10%. 


a) What is the undamped natural frequency? 
b) What is the damped natural frequency? 


FIGURE 5.74 
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c) What input frequency will produce the largest magnitude output? 

d) This meter is now used to measure a 1-V AC input with a frequency of 2 rad/s. 
What is the amplitude the meter will indicate after initial transients have died out? 
What is the phase lag of the output with respect to the input? Use a Bode magnitude 
and phase plot analysis. 


6~/ 1=40 x 10 kg : m? 


k-4 x 109 kg m?/s? 


T=input torque 


mË 
v =input voltage 


Kn=4x10°N-m/V 
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5.10 Determine the range of K for which each system is stable by making a Bode 
plot with K = 1 and imagining the magnitude plot sliding up or down until in- 
stability results. Qualitatively verify the stability rules by a very rough root-locus 
sketch. 


K(s + 2) 

s+10 ` 
OK. 
(s + 10)(s -2) 


K(s + 10)(s + 1) 
(s + 100)(s + 2)3° 


a) KG(s) = 


b) KG(s) = 


c) KG(s) = 


5.11 Determine the range of K for which each system is stable by making a Bode 


plot with K = 1 and imagining the magnitude plot sliding up or down until in- 
stability results. Qualitatively verify the stability rules by a very rough root-locus 
sketch. 
K(s + 1) 
K = ———.. 
ay A) = See HD 
K(s + 1) 
b) K = ——. 
aoe sis + 2) 
K 
KG(s) = ——————. 
quuin em TER S 
+ 1)? 
d Kats) = SETY 


s3(s + 10) 
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FIGURE 5.75 


Section 5.5 
5.12 a) Sketch the Nyquist plot for a 1/s* open-loop system; that is, sketch. 


5.13 


5.14 


5.15 


where C, is a contour enclosing the entire RHP, as shown in Fig. 5.14. 
Hint: Assume C, takes a small detour around the poles at s = 0, as shown in Fig. 
5:29; 

b) Repeat the problem for a 1/(s* + wĝ) open-loop system. 


Draw the Nyquist diagrams of the following systems. 


_ K(s +2) 
a) KG(s) = era 
K 

o xem = Eti D 


— (s + 100)(s + 2) 


Estimate the range of K for which each system is stable, and qualitatively ver- 
ify your result by a rough root-locus sketch, if not already done for Problem 
5.10. 


Draw the Nyquist diagrams for the following systems. 


— K(st) 
A RGU ay + T) 

_ Ks D) 
b KG) = T. 
c) KG(s) E 


~ (s*2)5?-9) 


d) For (b) and (c), choose the Nyquist contour to be to the left of the singularities on 
the imaginary axis and interpret the Nyquist plot in each case. 

e) Estimate the range of K for which each system is stable and verify with a root 
locus, if not already done for Problem 5.11. 


Draw the Nyquist plot for the system in Fig. 5.75. Determine the range of K for which 
the system is stable. 
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5.16 a) Sketch the phase for œw = 0.1 to 100 rad/s for the minimum phase system 


Lx . 8*1 
Gyo) = s +10 
$7 jo 
and the nonminimum-phase system 
cx cs b RE 
oV) = s +10 
s— jo 


noting that Z (jæ — 1) decreases with w rather than increasing. Does an RHP zero 
affect the relationship between the —1 encirclements on a Nyquist plot and the 
number of unstable closed-loop roots in Eq. (5.22)? 

b) Sketch the phase for w = 0.1 to 100 rad/s for the unstable system 


s-— jo 


€) Check stability of the systems in (a) and (b) using the Nyquist criterion, and check 
your results qualitatively using a root-locus sketch. 


5.17 Let 


100[(s/10) + 1] 


G(s) = Ts”) — 116/100) + IT 


The Bode plot of G(s) is provided in Fig. 5.76. 


a) Sketch the Nyquist plot for G(s). 
b) Is the closed-loop system shown in Fig. 5.77 stable? 


5.18 In Fig. 5.78 


G(s) = 25(s + 1) 
s(s + 2)(s? +25 + 16): 

Carefully draw a Bode plot of the frequency response of G(j«) and use this data to 

plot a Nyquist plot of G(j«). Conclude whether or not the loop is stable. Sketch a 

root locus and verify your conclusion. 


5.19 Consider the system given in Fig. 5.79. 


a) Using the Routh criterion, determine closed-loop stability for all values of K. 

b) Sketch the locus of the closed-loop poles as K varies from zero to infinity. (Include 
angles of departure or arrival and K and s values at breakpoints and crossings of 
the imaginary axis.) 

€) Sketch the Nyquist plot of the closed-loop system and use it to verify the results 
of (a) and (b). 
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FIGURE 5.76 
Bode plot for Problem 5.17. 
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FIGURE 5.77 


FIGURE 5.78 


FIGURE 5.79 


s 
2 


(s+1) +1 


Section 5.6 


5.20 Correlate the Nyquist plots, frequency responses, and step responses shown in 
Fig. 5.80. 


5.21 a) Assuming an open loop 


w2 


oul s(s + Xo) 


with unity feedback, the closed-loop system is 


x 
F(s) = ——————. 
(s) s? + 270,5 + w? 


Set w, = l and draw Bode plots for ¢ = 0.1, 0.4, and 0.7 to verify the values 
of PM in Fig. 5.32. By plotting G versus w/w,, the value of w, does not enter 
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FIGURE 5.80 
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FIGURE 5.81 


5.22 


5.23 


Problems 345 


the problem. If the loop gain is some value other than 1, does the relationship 
between PM and the closed-loop system damping change? 


b) Show that PM = an / | /1 + 4f4 — 22 


For the unity feedback system with 


l 


C65) = F D - 0.4(5/5) *- 1] 


a) Draw the Bode plots (gain and phase) for G(jw). 

b) Indicate the gain margin when the gain is set for a phase margin of 45°. 

c) What is K, when the gain is set for a 45? phase margin? 

d) Sketch the root locus versus K and indicate the roots for a phase margin of 45*. 


Let 


l ji 
G(s) = (s 4- 2y(s 4-4) and H(s) = marie 


5.24 


The root locus for the system depicted by the block diagram in Fig. 5.81 is shown in 
Fig. 5.82. 


a) Using root-locus methods, determine the value of K at the stability boundary. 

b) Using root-locus methods, determine the value of K that will produce roots with 
0.707 damping. 

c) What is the gain margin of the system if the gain is set to the value determined in 
(b)? Do not draw Bode or Nyquist plots. 

d) Draw the Bode plots for the system and determine the gain margin that results for 
a 65° PM. Using the rule-of-thumb in Eq. (5.25), what damping ratio would you 
expect for this PM? 

e) How does the root locus of the system shown in Fig. 5.83 differ from the one in 
Fig. 5.81? 

f) How does the transfer function Y>(s)/R(s) differ from Y,(s)/R(s)? 


For the system shown in Fig. 5.84, use a Bode plot and root locus to determine the 
gain and frequency at which instability occurs. What two values of gain give a PM of 
20°? What is the vector margin at these two values of gain yielding identical values 
for the PM? 
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Im(s) 
FIGURE 5.82 


Root locus for Problem 
a ASi: 


Re(s) 


FIGURE 5.83 


FIGURE 5.84 K (s + 1)(s+2) 
ss 3ys? + 2s +25) 


FIGURE 5.85 


FIGURE 5.86 


FIGURE 5.87 


5.25 


Problems 347 


A magnetic-tape drive speed-control system is shown in Fig. 5.85. The speed sen- 
sor is slow enough that its dynamics must be included. The speed-measurement 


time constant is 7, = 0.5 s, the reel time constant 7, = J/b = 4 s, the out- 
put shaft-damping constant is b = 1 N: m: s, and the motor time constant is 
mq = 15 


a) Determine the necessary gain K if the steady-state speed error is required to be 
less than 7% of the reference-speed setting. 

b) With the gain determined from (a), use the Nyquist criterion to investigate the 
stability of the system. 

c) Estimate the GM and PM of the system. Is this a good system design? Why? 


Amplifier and 
motor 


Tape drive 


5.26 


Sensor 


Apply the formal Nyquist criterion to determine the range of values of K (positive 
and negative) for which the system of Fig. 5.86 will be stable and to determine the 
number of roots in the RHP for those values of K for which it is unstable. Correlate 
with a root-locus sketch. 
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5.28 Repeat Problem 5.26 for the system shown in Fig. 5.88. 


FIGURE 5.88 


5.29 Two Nyquist plots for unity feedback systems that are open-loop stable are sketched 


5.30 


in Figs. 5.89 and 5.90. The proposed operating gain is indicated as Ko, and arrows 
indicate increasing frequency. In each case, give your best estimates for: 


a) Phase margin. 

b) Damping ratio to step response. 

c) Range of gain for stability (if any). 
d) System type as 0, I, or II. 


A ship's steering has the transfer function 


K,[—(s/0.142) + 1] 


GG) = 70.325) + 1][(s/0.0362) + 1]. 


a) Plot the log magnitude of G( jw) versus log w on log-log paper, with K, = 2. 
b) Plot the phase of G(jw) versus log w using the same frequency axis as used for 
the magnitude. 
c) 1) Indicate the crossover frequency on the plot of (a). 
2) Indicate the phase margin at crossover on the plot of (b). 
3) Indicate the phase-crossover frequency where œ = —180° on the plot of (b). 


Section 5.7 


$.31 


5.32 


The frequency response of a plant in a unity feedback configuration is sketched in Fig. 
5.91. Assume the plant is open-loop stable and minimum phase. 

a) What is the velocity constant K, for the system as drawn? 

b) What is the damping ratio of the complex poles at o — 100? 

c) What is the phase margin of the system as drawn? (Estimate to within +10°.) 
For the system 


100(s/a 4 1) 


Gs) * uo ine + D' 


where b — 10a, find a value of a that will yield good stability by plotting the 
frequency-response magnitude only. 
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FIGURE 5.89 


Imaginary 


FIGURE 5.90 
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Section 5.8 
5.33 a) Show that the magnitude 


l l 
(jolw,)? + 2£(jo/o,) - 1| 24% 


b) Show that 


l 


IF) = 2sinPM/2)' 


where F is the closed-loop transfer function and w, is the crossover frequency. 


FIGURE 5.92 
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c) By using results from (a) and (b), show that 


T a@PM° pM? 
360 100 
for small and PM. 
Section 5.9 
5.34 For the system in Fig. 5.92 
5 


G(s) = G4) + 1]IG/3) +1)’ 


design a lead compensation D(s) so that the phase margin is ~40°. What is the 
approximate bandwidth of the system? (Maintain parameters of D(s) so that its DC 
gain = 1.) 


5.35 Referring to Fig. 5.53, derive the transfer function from T4 to 6, then apply the 
final-value theorem (assuming 7, = constant) to determine whether 0(%) is nonzero: 


a) When D(s) has no integral term, that is, lim D(s) —constant; 
b) When D(s) has an integral term, that is, $ 


D(s) = DA 
S 
where lim D'(s) = constant. 
5.36 Consider the type I unity feedback system with 


K 


OM T i 


Design a lead compensator such that 


K, = 12sec™! and PM = 40°. 
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5.38 
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You are given the experimentally determined Bode plot shown in Fig. 5.93. Design 
a compensation that will yield a crossover frequency of 10 rad/s with a phase margin 
greater than 75°. 


In one mode of operation, the autopilot of a jet transport is used to control altitude. For 
the purpose of designing the autopilot loop, only the long-period airplane dynamics 
are important. The linearized relationship of altitude rate to elevator angle is therefore 
second-order. Specifically, 


h(s) |  20s-0.0) fus 
ó(s)  s*+0.01s + 0.0025 deg ` 


The autopilot receives an electrical signal proportional to altitude from the altimeter. 
This signal is compared with a command signal (proportional to the altitude selected 
by the pilot) and the difference provides an error signal. The error signal is processed 
through a compensation network, and the result is used to command the elevator 
actuators. A block diagram of this system is shown in Fig. 5.94. You have been given 
the task of designing the compensation. Consider first D(s) = K. 


a) Sketch the magnitude and phase versus frequency (Bode plots) of the open-loop 
system for D(s) = K = 1. 

b) What value of K would provide a crossover frequency of 0.16 rad/s? 

c) For the value of K in part (b), would this system be stable if the loop were closed? 

d) What is the PM? 

e) Sketch the Nyquist plot for K from part (b). Locate carefully the points where the 
phase angle is —180° and where the magnitude is unity. 

f) Sketch the root locus versus K. Locate the roots for your value of K from (b). 

g) What steady-state error would result with K from part (b) if the command were a 
ramp of 1 ft/s? Next consider 


Ts + 1 


D = kK ——_ 
(s) aTs +1 


h) Choose the parameters K, T, and o so the crossover frequency is 0.16 and the 
phase margin is greater than 50°. Indicate your work on the Bode plot of (a). 

i) Sketch the root locus versus K. Locate the roots for your value of K from (h). 

j) What steady-state error would result with the K from part (h) if the command were 
a ramp of 1 ft/s? 

k) If the error in (j) is too large, what type of compensation would you add? Approx- 
imately, at what frequencies would you put its breakpoints? 
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FIGURE 5.95 


5.39 


5.40 


5.41 


For the system with 


10 


G(s) = 4+ 11[G/3) + 1)’ 


design lag compensation so that PM ~40° while maintaining a DC gain of D(s) = 1. 
What is the approximate bandwidth of this system? 


a) Design a compensation for the ship-steering control of Problem 5.30 so as to 
maintain a velocity constant K, of 2, a phase margin = 50°, and unconditional 
stability (phase margin > 0 for all w = we). 

b) Draw a root locus of your final design versus K, and indicate the location of the 
closed-loop poles. 


Consider the system frequency-response characteristics shown for Problem 5.31. 


a) A lead compensation with a = 1/5 is introduced with its zero at 1/T = 20. How 
must the gain be changed to obtain crossover at œw = 31.6 rad/s and what is the 
resulting value of K,.? 

b) With the lead compensation in place, what is the required value of K for a lag 
network that will readjust the gain to the original K, value of 100? 

c) Place the pole of the lag at 3.16 rad/s and determine the zero location that will 
maintain the crossover frequency at w = 31.6 rad/s. Sketch the compensated 
frequency response on the same graph. 

d) Estimate the PM of the compensated design. 


Section 5.10 


5.42 A feedback control system is shown in Fig. 5.95. The specification for the closed-loop 


system requires that the overshoot to a step input be less than 30%. 


a) Determine the corresponding specification in the frequency domain M , (resonant 
peak value) for the closed-loop transfer function. 

b) Determine the resonant frequency w, for the maximum K that satisfies the speci- 
fications. 

c) Determine the bandwidth of the closed-loop system resulting from (b). 
Hint: Plot the open-loop magnitude versus phase (as shown in Fig. 5.56) on trans- 
parent paper, then slide it vertically on the Nichols chart (Fig. 5.55) to obtain the 


answers. 
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systems? 
c) What are the bandwidths of the uncompensated and compensated systems? 


b) What are the phase and gain margins of the uncompensated and compensated 
d) What type of compensation is used? 


a) What are the resonant peaks of the uncompensated and compensated systems? 


5.43 The Nichols plots of an uncompensated and compensated system are shown in 
Fig. 5.96. 


Nichols plot for Problem 5.43. 


FIGURE 5.96 


Sv} Closed- 
^S loop 
magnitude 
Closed- 
bon 


TAA Area 3 
/ SU S XA, 
AKC ATP 
NAANA HA, 

TIRS rt 


NENN woi- AT 
TFA H- 
IDERAN 
EATR RLH- 


aA ^ 


AOV SOM 
CNTR ues AN 
SEIEN NL 

NM 


Di 
TERR SVA | LESEN 


e 


Ilse 
- l 


Z Ds) Gs) 


TS 


el id 5 


« 
ES 


iil 
== FAm CO [X | | Ne 
Omn OON Oo wm x eo N OO o0 r- Qi Y e N mee 
r4 FOOO SOS o = o ci 
| (99 (S)q | 


356 Chapter 5 / The Frequency-Response Design Method 


FIGURE 5.97 


FIGURE 5.98 


5.44 


5.45 


5.46 


Consider the system in Fig. 5.86 on page 347. 


a) Construct an inverse Nyquist plot [Y (jo)/E( jo)] !. 

b) Show how the value of K for neutral stability (defined to be K,,) can be read 
directly from the inverse Nyquist plot. 

c) For K = 4, 2, and 1, determine the gain margin and phase margin. 

d) Construct a root-locus plot for the system and identify corresponding points in the 
two plots. To what do the GM and PM of (c) correspond? 


An unstable plant has a transfer function 
E . sl 
F (s— 1» 


A simple control loop is to be closed around it, as shown in Fig. 5.87. 


a) Construct an inverse Nyquist plot of Y/F. 

b) Choose a value of K to provide a phase margin of 45?. What is the corresponding 
gain margin? 

c) Can you infer from your plot the stability situation when K is negative? 

d) Construct a root-locus plot and describe the correspondence between the two plots. 
To what £ does the phase margin 45° correspond in this case? 


4 


s(s4-2)^ 


Consider the system shown in Fig. 5.97. 


a) Construct a Bode plot for the system. 

b) Use your Bode plot to sketch an inverse Nyquist plot. 

c) Consider closing a control loop around G(s), as shown in Fig. 5.98. Using the 
inverse Nyquist plot as a guide, read from your Bode plot the values of GM and 
PM when K = 0.7, 1.0, 1.4, and 2. What value of K yields 30° PM? 

d) Construct a root-locus plot and label the same values of K on the loci. For what 
value of ¢ does each PM/GM correspond? 


FIGURE 5.99 


FIGURE 5.100 
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5.47 Repeat Problem 5.46 for the system shown in Fig. 5.99. (Use values of K = 0.5, 1, 
2, and 4.) 


5.48 


5.49 


12.5 
(s+ 0.5) (s?-- 2s + 25) 


For the open-loop system, 


K(s + 1) 


AME s?(s + 10)?’ 


create the inverse Nyquist plot for G(s) and determine the values of K at the stability 
boundary and that yield a PM of 30°. 


Augment the system of Problem 5.46 to include a lead compensator as shown in 
Fig. 5.100. 


a) Superimpose the new root locus, Bode, and inverse Nyquist plots on your old 
ones. 
b) What value of K now produces PM = 30°? For this K what are the values of ¢ and 
GM? 
c) Compare the closed-loop system's lowest natural frequency, with and without the 
= network, when K is set to produce a PM of 30° in each case. 


Section 5.11 


5.50 Consider the system with the open-loop gain 


im s(s +1) 


a) Draw the Bode and Nyquist plots and find the GM, PM and vector margin (@ min) 
for the system. 

b) Compute the sensitivity and complementary sensitivity functions and plot their 
magnitude frequency responses. 

c) Find estimates of the GM and PM from (b) by determining & min and using Eqs. 
(5.52) and (5.53). Compare the results to those of (a) and comment on their 
conservatism. 
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FIGURE 5.101 
Nonlinear feedback with 
inputs rı and r2 and 
outputs 41, Y1, U2, 

and y2. 


FIGURE 5.102 

Typical feedback system 
with plant dynamics G 
and feedback dynamics 
D. The reference input 
is r and the disturbance 
input is d. 


d) Draw the inverse Nyquist plot for the system. Identify the complex (vector) margin. 
Compute the approximate values of the PM and GM based on the complex margin 
and compare with (a). 


5.51 Small-Gain Theorem. An alternative derivation of the stability robustness results is 


possible via the small-gain theorem (Zames, 1966; Mees, 1981). Consider the system 
shown in Fig. 5.101, where H, and H, are not necessarily linear. The small-gain 
theorem states that if the inputs (rı and r2) are bounded and if, in addition, the 
open-loop gain is less than 1, that is, 


IH; |Hi| « aL 
then the feedback system is closed-loop stable, that is, 4i, u», Yı, and y» are all 


bounded. Now consider the typical feedback system shown in Fig. 5.102, where it is 
known that 


< [(co). 


[m 


Go 


Prove that the system shown in Fig. 5.103 is equivalent to that of Fig. 5.102. Apply the 
small-gain theorem to the system shown in Fig. 5.103 to obtain the stability robustness 
result (Eq. 5.66) derived in this chapter. Why is it not useful to apply the theorem to 
the system in Fig. 5.102? 
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FIGURE 5.103 
Equivalent feedback representation of Fig. 5.102. 


Section 5.12 


5.52 Find the maximum possible bandwidth for the system below with a 0.2-s time delay 
(T = 0.2s), keeping PM = 40°. 


e 025 
9)" OF IO 
a) Use one section of lead 
TS +1 
D(s) = K ————, 
uisi ES 
where a = i. 
b) Use two sections of lead 
Bixee) 
aTS +1} ’ 


where a = +. 
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5.53 Determine the range of K for which the following systems are stable: 


-sS 


a) G(s) = K— 
» 


—$ 


e 
b) G(s) — d TD 


5.54 A pure time delay, that is x ou(t) = Xin(t — 7), is represented by H(s) = e`“. 


a) Graph |H( jo)| and ZH(jo) versus w. 

b) H(s) cannot be represented exactly as a ratio of polynomials in s. Therefore H (s) 
cannot be described by a collection of poles and zeros. However, H(s) may be 
approximated by a rational polynomial. Consider 


Í — (75/2) 


OnE o7. 


Plot |H,(j@)| and ZH (jœ), and compare your results with those from (a). Note: 
H,(s) is a first-order Padé approximant to a time delay. Rational polynomial ap- 
proximations to H(s) may be constructed using RLC networks, whereas H(s) 
cannot be realized with any lumped element network. 


6.1 


State-Space 


Design 


Introduction 


The idea of state space comes from the state-variable method of describing dif- 
ferential equations. In this method, dynamic systems are described by a set of 
first-order differential equations in variables called the state, and the solution may 
be visualized as a trajectory in space. The method is particularly well suited to 
performing calculations by computer. State-space control design is the technique 
whereby the control engineer designs compensation by working directly with the 
state-variable description of the system. 

Use of the state-space approach has often been referred to as modern control 
design, whereas use of transfer-function-based methods such as root locus and 
frequency response have been referred to as classical control design. However, 
since the state-space method of description for differential equations is over 100 
years old and was introduced to control design in the late 1950s, it seems somewhat 
misleading to refer to it as “modern.” We prefer to refer to the two approaches to 
design as state-space methods and transform methods. 

Both the root-locus and frequency-response design techniques discussed in 
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FIGURE 6.1 


Control-system design 


definition. 


6.2 


D(s) 


Chapters 4 and 5 are aimed at finding a compensation D(s), shown in Fig. 6.1, that 
best satisfies the design specifications. The goal of the state-space design technique 
is precisely the same; however, because the method of describing the plant and the 
compensation is so different from the other techniques, it may seem at first that an 
entirely different problem is being solved. The examples given toward the end of 
this chapter should help convince the reader that, indeed, state-space design does 
result in the same sort of D(s) that is obtained with the other methods. 

Advantages of state-space design are especially apparent when engineers de- 
sign controllers for systems with more than one control input or more than one 
sensed output; however, in this chapter, we will illustrate the ideas of state-space 
design using single-input, single-output systems. A further advantage of state-space 
design is that the system representation provides a complete (internal) description 
of the system, including possible internal oscillations or instabilities that might 
be hidden by inappropriate cancellations in the transfer-function (input/output) de- 
scription. 


System Description 


The motion of any finite dynamic system can be expressed as a set of first-order 
ordinary differential equations. This is often referred to as the state-variable repre- 
sentation. For example, Newton’s law for a single mass M moving in one dimension 
x under force F is 


Mx = F. (6.1) 


If we define one state variable as the position x; = x and the other state variable 
as the velocity x» = x, this equation can be written as 


X1 = ADs 


(6.2) 


F 
X2 M 
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Furthermore, first-order linear differential equations can be concisely expressed 
using matrix notation. While linear algebra is a vast topic, and one with which 
control engineers need to be very familiar, we will use only the most basic relations 
and results here. A few of these results from the point of view of matrix algebra 
are collected in Appendix C for reference, study, and review. 

Consider again the state equations of Eq. (6.2). If we collect the state into a 
column vector x, and the coefficients of the state equations into a square matrix F, 
and the coefficients of the input into the column matrix G, these equations can be 
written in matrix form as 


X] E 0 1 X1 0 F 
X2 - 01| x2 «ig (6.3) 
or 
x = Fx + Gu, 


where F is the system matrix and G is the input matrix. If we take the output to 
be y = xı, this too can be expressed in matrix form as 


(6.4) 


or 
y = Hx, 


where H is a row vector, referred to as the output matrix. Collecting these matrix 
equations, we have the extremely compact notation, 


x = Fx + Gu + Giw, (6.5) 
y = Hx+ Ju, (6.6) 


where the system input has been divided into control input u and the disturbance 
input w. Furthermore, we have added the term Ju to include the possibility that there 
is a direct path from the input u to the output y. J is called the direct transmission 
or the feedthrough term. Therefore, the transfer function of the control input u to 
system output y— which has been used heretofore as the system description and 
called G(s)—is now replaced by the state-variable description given by Eqs. (6.5) 
and (6.6). Figure 6.2 shows the two different methods of system representation for 
the case where there is no disturbance input (G; = 0) and no direct transmission 
term (J = 0). 

Similarly, the differential-equation models of more complex systems, such as 
those developed in earlier sections on mechanical, electrical, and electromechan- 
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FIGURE 6.2 

System representation: 
(a) transform method and 
(b) state-variable 
method. 


EXAMPLE 6.1 


FIGURE 6.3 
A two-mass system. 


U 
(s) Gis) Y (s) 


(a) 


u x 
| mee een : 
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ical systems, can be described by state variables through selection of positions, 
velocities, capacitor voltages, and inductor currents as state variables. In Section 
2.3, Eqs. (2.16) and (2.17) have already been manipulated into state-variable form 
through selection of suitable variables. 


As an example of the formation of equations in state-variable form, consider the 
two-mass system shown in Fig. 6.3. 
The equations of motion are (see Section 2.2) 


M$-b(y—-d)-k(y—-d)- u, 
md + b(d — y) + k(d — y) = 0. (6.7) 


If we take the state as the position and velocity of each mass as follows: 


A] = 


y 
X2 7 y 
x3=d 

d 


A = 


, 
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the equations in state-variable form are 


ky = X3 

à; k b k b u 

2 = Brad E "E + 4? F ya + M 

X3 = X4, 

X4 = PL + x; -— xs 2 2 xy, (6.8) 


which, again, is the same form as Eq. (6.5) and, including the output y in (6.6), 
the state-space matrices are 


0 l 0 0 
k b k b n 
0 0 0 1] 0 
k b k b 0 
m m m m 
H=[1 0 0 0] J =0. m 


EXAMPLE 6.2 Consider the equation of motion for the simple pendulum shown in Fig. 6.4, 
which is 


3 T 
Ó + ej sinü = —S, à 
Wo Sin "n (6.9) 


FIGURE 6.4 
A simple pendulum. 
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where wg = g/l. If we choose as the state variables x; = wo@ and x2 = 0, then 
the equations are 
X] = 00X5; 


Te 
ml? 


+ (6.10) 


à 2 . [XI 
X2 = —Wp sin| — 
w0 


These equations are nonlinear but are in state-variable form. Possible equilibrium 


state variables for the pendulum (obtained by setting x; = 0, x2 = 0) are down 
(x; = 0) or up (x; = 7709); that is, 

x; =0 or TW, 

x5 = 0. 


If we assume the motion is close to the down position, we can linearize the 


equations about the solution x; = x5 = 0, and hence, since sin(0) ~ 6 for 
small x, 
X| = WoXx?2 
; (g 
X2 = —o9ogx, + ati (6.11) 
ml 


where |x;|/eo < 1. Once again, the result fits Eqs. (6.5) and (6.6), and the 
state-space matrices with measurement of 0 are 


0 
F = Es d G=| 1 |; 
° ml? 
l 
H =| = IF J =0 m 
Wo 


EXAMPLE 6.3 Consider the spacecraft system shown in Fig. 2.6, with the dynamics of a sensor 
lag added to it. Its system description, using the transfer-function block diagram, 
is contained in Fig. 6.5. This same system can also be specified (see Problem 6.1) 


Mya (disturbance input) 
FIGURE 6.5 


Example system 
description. 


Spacecraft 
Mo + 


0.9 


2 
S 


2 


s+2 


(control input) 


6.2 / System Description 367 


by equations in the form of Eqs. (6.5) and (6.6): 


q 0.0 0 q 0.9 0.9 
gj;=!;1 0 0 0 |+| 0O|M.+!] 0 | Mı, (6.12) 
Ôn 0 2 =2 | 0n 0 0 
x = F X T G u T G; W, 

q (6.13) 
y=[0 0 1]i 0 y = Hx 

0, Eg 


EXAMPLE 6.4 Consider the longitudinal dynamics of an aircraft (Fig. 6.6). It obeys the equations 
of motion for any mechanical system given by Newton's laws [Eqs. (2.1) and (2.5)]. 


FIGURE 6.6 
(a) Boeing 747 aircraft (courtesy Boeing Commercial Airplane Co.); (b) definition of aircraft coordinates. 
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The forces are from aerodynamic lift and drag, the propulsion system, and gravity. 
Except for gravity, the forces are most easily expressed in a coordinate frame that 
is fixed to and rotating with the aircraft. Newton’s laws need special expression in 
such a coordinate frame because in general it may be rotating with respect to the 
Earth’s surface. It is therefore necessary to modify the equations to account for 
the rotation of the coordinate frame. For a detailed derivation of the equations, see 
Ashley (1974). 
For linearized longitudinal motion, the results are 


where 


u Xu Xw -Wo — 8 COS 0o u Xse 

Ww Z. -Lw Uo — sin ĝo w 4 Z8e 8e. 
q M, Mw M, 0 q Ms. 

0 0 0 l 0 0 0 


u = forward velocity perturbation in the aircraft in x direction [see Fig. 


0o 
de 


6.6(b)], 
velocity perturbation in the aircraft in z direction (also proportional to 
the angle of attack, a = w/U9), 


= angular rate about positive y axis, or pitch rate, 


pitch-angle perturbation with respect to horizontal, 

normalized aerodynamic force derivatives in x direction, 

normalized aerodynamic force derivatives in z direction, 

normalized aerodynamic moment derivatives, 

reference flight-condition velocity in z axis (usually = O for an aircraft 
flying horizontally) ,* 

reference flight-condition velocity in x axis (that is, the forward velocity 
of the aircraft) ,* 

acceleration of gravity (32.2 ft/s* or 10 m/s?), 

angle of the x axis from horizontal in the reference flight condition, 


= movable tail-section, or “elevator,” angle for pitch control. 


For the Boeing 747 in horizontal flight, U = 830 ft/s at 20, 000 ft (Mach 0.8) 
with a weight of 637, 000 Ib, we have 


DA Ez. me 


We shall study this example in detail in Chapter 7. 


—0.00643 0.0263 0 —32.2 11 H 0 

—0.0941 —0.624 820 0 wl “32 d Se 

= .000222  —0.00153  —0.668 0 q — 2,08 
0 0 l 0 0 0 


* The Woq and Uoq terms in the equations account for the acceleration of the coordinate frame due to 
aircraft rotational rates. 
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Equations (6.5) and (6.6) express the algebraic connection between input u 
and output y and state x. The state for the specific cases above is of dimension 
2, 3, and 4, but Eqs. (6.5) and (6.6) can be used to describe a system of any 
dimension — 10, 200, or n for any integer n. Thus, we can express algebraic re- 
lations between input and state between state and output, and between one state 
representation and another by matrix algebra on the F, G, and H; then these gen- 
eral expressions can be converted to specific cases by substituting the appropriate 
values of parameters. 

Thus far, we have seen that the ordinary differential equations of physical 
dynamic systems can be manipulated into state-variable form. In fact, in the field 
of mathematics, where ordinary differential equations are studied, the state-variable 
form is called the normal form for the equations. There are several good reasons 
for the study of equations in this form, and some of them are listed here: 


To study more general models. The differential equations do not have to be 
linear or stationary. Thus, by the study of the equations themselves, we develop 
methods that are very general. Having them in state-variable form gives us a 
compact, standard form for the study. Of course, in this book we study mainly 
linear, constant models (for the reasons given earlier). 


To introduce the ideas of geometry into differential equations. In physics the 
plane of position versus velocity of a particle or rigid body is called the phase 
plane. The state is a generalization of that idea to more than two dimensions. 
While we cannot plot more than three dimensions, the concepts of distance 
as well as of "orthogonal" and "parallel" and other concepts from geometry 
can be useful in visualizing the solution of a differential equation as a path in 
state-space. 


To connect internal and external descriptions. The state of a dynamic system 
often directly describes the flow of internal energy, as when we select posi- 
tion (potential energy), velocity (kinetic energy), capacitor voltage (electric 
energy), and inductor current (magnetic energy). In every case, the state is 
equivalent to this direct accounting and the internal energy can always be com- 
puted from the state. By a system of analysis that we will shortly describe, 
we can relate the state to the system inputs and outputs and thus connect the 
internal variables to the external inputs and to the sensed outputs. In contrast, 
the transfer function just relates the input to the output and does not show the 
internal behavior. The state form keeps this sometimes important connection. 


6.2.1 Block Diagrams and State-Space 


Perhaps the most effective way of understanding the state-space equations is via an 
analog computer, block-diagram representation. The structure of the representation 
uses integrators as the central element, which are quite suitable for first-order, 
state-space representation of equations of motion for a system. Even though the 
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FIGURE 6.7 
An integrator. 


FIGURE 6.8 
Elements of an analog 
computer. 


use of analog computers has declined, it is still a useful concept for state-space 
design and in the circuit design of analog compensation. 

The analog computer is a device composed of electric components designed 
to simulate ordinary differential equations. The basic dynamic component of the 
analog computer is the integrator, constructed from an operational amplifier with 
a capacitor feedback and a resistor feed-forward, as shown in Fig. 2.16(b). Since 
an integrator is a device whose input is the derivative of its output, as shown 
in Fig. 6.7, if, in an analog-computer simulation, we identify the outputs of the 
integrators as the state, we will then automatically have the equations in state- 
variable form. Conversely, if a system is described by state variables, we can 
construct an analog-computer simulation of that system by taking one integrator 
for each state and connecting its input according to the given equation for that state 
as expressed in the state equations. The analog-computer diagram is a picture of 
the state equations. 

The components of a typical analog computer used to accomplish these func- 
tions are shown in Fig. 6.8. Notice that the operational amplifier has a sign change 
that gives it a negative gain. Implementation of a simulation of a differential equa- 
tion with an analog computer is best illustrated by an example, and we will start 
with a third-order differential equation. Consider the system represented by the 
equation 


y +69 + lly + 6y = 6u. (6.14) 


If we assume that y is "available," one integration will give y, another will give 
y, and another will give y itself. With these variables at hand, the equation for y 


i 
eS [ dt+IC 
e97 (10e1 +eg)dt+ 
Integrators " i 8 


o 
ei 
Summers eo= —(10e1+e2) 
e2 
Potentiometers ©1 >) eọ=ke; 0<Sk<1 


FIGURE 6.9 

Block diagram of a 
system to solve y + 
6y + lly +6y = 6u 
using only integrators 
as dynamic elements. 
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given by Eq. (6.14) can be implemented and the simulation is complete. The block 
diagram of the resulting realization is shown in Fig. 6.9. The state variables, the 
outputs of the integrators, are x; = y, x2 = y, and x3 = y. In these terms, the 
equations of motion are 


X1 = ADs 
X2 — Uds 
X3 = —6x, — llx2 — 6x3 + 6u. (6.15) 


As we noted above, the analog computer based on the operational amplifier 
uses integrators that have a negative gain, so a modification of the block diagram 
is necessary to take that into account. The realization of this system using analog- 
computer components is shown in Fig. 6.10. 

Notice here that the outputs of the integrators are —y, y, and —y. Also note 
that an amplifier (sign changer) is needed to get the correct sign of y. We frequently 
use a block diagram having only integrators as dynamic elements to help visualize 
the meaning of certain state-space selections and to display the relations between 
input, state, output, and transfer function. The translation of such a block diagram 
into specific analog-computer components, including correct signs and gains, is 
done only if an actual simulation is to be run. 


6.2.2 State Transformations 


A particular definition of the state vector x can be redefined by any nonsingular 
linear transformation of that state, p — Tx. The new state vector p will describe 
the identical system as x with suitable changes to F, G, G;, H and J. 

For example, if, in the spacecraft example of Fig. 6.5, we define a new state 
to be 


0 
p=| 6}; that is T-^/|0 
l 
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FIGURE 6.10 
Example of an 
analog-computer 
simulation of y +6)+ 
lly + 6y = 6u. 


instead of the state definition given in Eq. (6.12), we see that the following revisions 
of the state-space matrices, 


-2 20 0 
F-|0 01], G'-Gj- 0|, H'-[1 0 0], 
0 00 0.9 


will result in identical system dynamics. 

For more complicated systems where the revised matrices cannot be deter- 
mined by inspection, we can derive formulas for the revised matrices (see Prob- 
lem 6.2): 


F-TFT'; G'-TG; Gj-TG; H'-HT. (6.16) 


This kind of transformation is sometimes used to arrive at a “canonical” form 
of the equations, which is well suited to a particular analysis. One commonly 
used transformation converts F to a diagonal matrix (if possible); therefore each 
diagonal element represents a pole of the system transfer function, and the state 
vector describes the normal modes. Other canonical forms will be described in 
subsequent sections. 


6.2.3 System Transfer Functions 


In order to relate the state-variable equations to our earlier consideration of fre- 
quency response and poles and zeros, let's now go back to the nonhomogeneous 
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formula, Eq. (6.5), and consider the problem in the frequency domain. Taking the 
Laplace transform of 


x = Fx + Gu, (6.17) 
we obtain 
sX(s) — x(0) = FX(s) + GU(s), (6.18) 


which is now an algebraic equation. If we collect the terms involving X(s) on the 
left-hand side, we find (remember that in matrix multiplication it is very important 
to keep the order)* 


(sI — F)X(s) = GU(s) + x(0). 
If we premultiply both sides by the inverse of (sI — F), then 
X(s) = (sI — F) !'GU(s) + (sI — F) !x(0). (6.19) 
The output of the system is 
Y(s) = HX(s) + JU(s), 

which means 

Y(s) = H(sI - F) 'GU(s) + H(sI — F) !x(0) + JU(s). (6.20) 
If we assume that the initial conditions are zero, the input-output relationship is 


2 Ht _ Pp! 
G(s) = p; = ESI- DG + J. (6.21) 


This G is called the transfer function of the system. 


Consider the system with state-variable description 


na an l 
rN 
J =0. 


The block diagram corresponding to these matrices is given in Fig. 6.11. To com- 


*The matrix I is the identity, a matrix of 1s on the main diagonal and zeros everywhere else and 
therefore Ix = x. 


t Note that the initial-condition assumption is important and is always a factor when dealing with transfer 
functions. 
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FIGURE 6.11 
Block diagram of a 
second-order system. 


pute the transfer function, form 


a-r-|**? : 


-1 S 


and compute 


S —6 
1 st+5 


Dp- — 
a= E) sis +5) +6 


Therefore 


s —6 ||1 
[0 i vss lol 


olay s(s +5) +6 
E [1 5+51/4| 
i s(s +5) +6 
1 
— (s-2Ys + 3)’ ue 


Since Eq. (6.21) expresses the transfer function in terms of the state-space 
matrices F, G, H, and J, we should be able to express poles and zeros in terms 
of these matrices too, and we can. 


6.2.4 Poles, Zeros, and Eigenvalues from the State-Space Description 


A pole of the transfer function G(s) is a value of frequency s such that, if 
s = Ài, then the system responds as K;e^', with no forcing function. À; is called a 
natural frequency of the system. In state-space we have, from Eq. (6.5) with no 
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forcing function, 
X — Fx, (6.23) 
and we assume 
x(0) = Xo, (6.24) 


where xo is a constant initial-condition vector. If we also assume that x(t) = e4''xo, 
it follows that 


X(t) = Aje"'xy = Fx = Fe^'x, (6.25) 
or 
Fxo = A;Xo. (6.26) 
We can rewrite Eq. (6.26) as 
(A;I — F)xo = 0. (6.27) 


Equations (6.26) and (6.27) are well known in matrix algebra as equations of 
eigenvalues A; and eigenvectors xo of the matrix F. For a nonzero xo, the above 
equation is satisfied if and only if 


det[A;I — F] = 0. (6.28) 


These equations show that the poles of the transfer function are the eigenvalues of 
system matrix F. 


Consider the system with poles at —2 and —3 and a transfer function of 


1 1 
Ane Fute (04263) 


We saw earlier that a state-variable description of this transfer function is 
— UB 

1 0 
H = [0 1], J =0. 


| 


The poles of the system are found from Eq. (6.28) by solving the characteristic 
equation 
det[sI — F] = 0, 


s+5 S| =o, 


=f (6.29) 


det | 


or 
s(s +5) + 6 = (s + 2)(s + 3) = 0, 


and we confirm that the poles of the system are the eigenvalues of F. B 
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The eigenvalues of quite large systems can be computed using the QR algo- 
rithm* (Francis, 1961). 

The zeros of the system can also be determined from the state-variable de- 
scription matrices (F, G, H, and J). A zero is a value of frequency s such that if 
the input is exponential at the zero frequency, or 


u(t) = uge, (6.30) 
then the output is identically zero; that is, 
y(t) = 0, (6.31) 


which means that the system has a nonzero input signal but nothing comes out! In 
state-space description, we would have 


n= me: a(7) = xe": y(t) =0. (6.32) 
Thus, we have that 
X = se?xy = Fe'xo + Guge“ (6.33) 
or 
[sI - F, -G]| ^| =0 (6.34) 
uo 
and 
y = Hx + Ju = He™ xp + Juge! 20. (6.35) 
Combining Eqs. (6.34) and (6.35), we have that 
rs ud E H | (6.36) 


A zero of the state-space system is a value of s where the above equation has 
a nontrivial solution. With one input and one output, the matrix is square and a 
solution to Eq. (6.36) is equivalent to a solution to 


sI-F -G 


det H J 


= 0. (6.37) 


Consider a transfer function with a zero at —2 


s+2 


aa s(s +3)’ 


*This algorithm is available at most computer centers and is carefully documented in the software 
package EISPAK (Garbow et al., 1977). 


6.3 


6.3 / Control Law Design for Pole Placement 377 


which corresponds to the state-variable description 


=|- jl s-[j.: E k: 


0 0 2 > 
H=[i 0; 90 — 4 
The zeros are such that [from Eq. (6.37)] 
SES -L-—i 
det} O0 s =—2| = 0, N 

l 0 0 d 
Or " 

2+5 =0, L 

s = —2. p 


These results can be combined to express the whole transfer function in a 
compact form (see Appendix C): 


det 


sI-F -G 
H 7 
det[sI — F] f 


since both numerator and denominator polynomials can be expressed in terms of 
determinants. For a numerically stable algorithm to compute transfer functions, 
see Emami-Naeini and Van Dooren (1982). Given the transfer function, we can 
compute the frequency response as G(jw), and, as we have seen, Eqs. (6.28) and 
(6.37) can be used to find the poles and zeros from which the transient response 
follows, as we saw in Section 2.7. 


G(s) = (6.38) 


Control Law Design for Pole Placement 


One of the attractive features of the state-space design method is that the procedure 
consists of two independent steps. One step assumes that we have all the elements 
of the state vector at our disposal for feedback purposes. In general, of course, this 
would be an unreasonable assumption, since a well-trained control designer would 
know that, using other design methods, it would not be necessary to provide that 
many sensors. The assumption that all state variables are available merely allows 
us to proceed with the first design step, namely, the control law. The next step is 
to design an estimator (sometimes called an observer), which estimates the entire 
state vector when provided with the measurements of the system indicated by the 
output [Eq. (6.6)]. The final step will consist of combining the control law and 
the estimator, where the control law calculations are based on the estimated state 
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FIGURE 6.12 
Schematic diagram of 
state-space design 
elements. 


5i Control law DUM 
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variables rather than the actual state. In Section 6.6, we show that this substitution 
is reasonable and that the combined control law and estimator gives closed-loop 
dynamics (as determined by the closed-loop pole locations) that are unchanged 
from those determined when designing the control law and estimator separately. 
Figure 6.12 shows how the control law and the estimator fit together and how 
the combination takes the place of what we have been previously referring to as 
dynamic compensation. The figure shows the command input r introduced in the 
same relative position as previously; however, in a later section we will show how 
a different location will usually provide superior control. 

The first step, then, is to find the control law. Assuming temporarily that there 
is no command input (r — 0),* the control law is the simple feedback of a linear 
combination of all the state variables— that is, 


X1 
X2 

u = —Kx = —[K,K2°°:K,]| . |. (6.39) 
Xn 


Therefore the system has a constant matrix in the state-vector feedback path, as 
shown in Fig. 6.13. For an nth-order system, there will be n feedback gains 
K,,..., Kn, and since there are n roots of the system, there are enough degrees 
of freedom to select arbitrarily any desired set of root locations by proper 


* This assumption will be removed in Section 6.7. 


FIGURE 6.13 
Assumed system for the 
control-law design. 
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choice of the K’s. This is not always so in transform design methods where the 
number of design parameters in the compensation is usually less than the order of 
the system being controlled. 

Substituting the feedback law, Eq. (6.39), into the system, Eq. (6.5) yields 


x = Fx — GKx + Giw. (6.40) 


Therefore, the homogeneous portion, which determines the system’s natural behav- 
ior, iS 


x = (F - GK)x, (6.41) 
and the characteristic equation of this closed-loop system is 
det[sI — (F — GK)] = 0. (6.42) 


When evaluated, this yields an nth-order polynomial in s containing the n gains 
K,,...,K,. The control-law design then consists of picking the gains K so that 
the roots of Eq. (6.42) are in desirable locations. 

Selection of desirable locations for the roots usually requires some iteration by 
the designer. Some of the issues in their selection will be discussed in the following 
examples and will be further discussed in Section 6.4. For now, we will assume 
that the desired locations are known, say, 


S = -My Sig. ow pede 
Then the desired (control) characteristic equation is 
G(s) = (5 — S16 — 82)°*"(s — $4) = O. (6.43) 


Hence, the required elements of K are obtained by matching coefficients in Eqs. 
(6.42) and (6.43), thus forcing the system-characteristic equation to be identical 
with the desired formula, Eq. (6.43). An example should help clarify this pole 
placement idea. 
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EXAMPLE 6.8 Suppose we have an undamped oscillator with frequency wo and a state-space 
description given by 


0 
1 


X] 


Xe u, (6.44) 


_{| 0 1 
 |-eà 0 


X2 
and we wish to relocate the poles of the system so that they are both at —2«9. In 


other words, we wish to double the natural frequency and increase the damping 
from ¢ = 0 to ¢ = 1. From Eq. (6.43), we find that 


a-(s) = (s + 209) = s^. 4wos + 4w6, (6.45) 
and from Eq. (6.42), 


des = Œ ~ GK] = de g a | ee Tehi 3l 


WO 
or 
s? + Kos + we +K =0. (6.46) 
Equating the coefficients with like powers of s in Eqs. (6.45) and (6.46) yields 
K = 4a, 
w? + Kı = 4e, (6.47) 
and therefore 
K, = 309, 
K = 4a. 
Or, more concisely, the control law is 
K-[K; K2] = [36 4o]. (6.48) 
Figure 6.14 shows the response of the closed-loop system to the initial condition 
x; = 0.3, x; = —0.5, and wọ = 1. It shows a very well-damped response, as 
would be expected from two roots at s = —2. a 


The calculation of the gains using the technique illustrated in this example 
becomes rather tedious when the order of the system is larger than 3. There are, 
however, special “canonical” forms of the state-variable equations where the algebra 
for finding the gains is especially simple. One such canonical form useful in control- 
law design is the control canonical form. Consider the third-order system* 


y +a + a2% + asy = bit + Dou + bau, (6.49) 


*This development is exactly the same for higher-order systems. 
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FIGURE 6.14 


Undamped oscillator 1.2 "aede A SIN i 
response with full-state 
feedback (wọ = 1). 1.0 Ik — —;[1—— —————JÀ— íi H 


2.0 2.5 3.0 3.5 4.0 
Response with full-state feedback (o9 1) 


which corresponds to the transfer function 
(6.50) 


Suppose we introduce an auxiliary variable (referred to as the partial state) £, 
which relates to a(s) and b(s) as shown in Fig. 6.15(a). The transfer function of 


u to € is 
f(s) _ 1 
U(s) = ae (6.51) 
or 
E +aië + aré + as£ = u. (6.52) 


It is easy to draw a block diagram corresponding to Eq. (6.52) if we rearrange the 
equation as follows: 


é= -aë = aré —a3E + u. (6.53) 
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FIGURE 6.15 
Derivation of control 
canonical form. 


(a) 


(b) 


(c) 
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The summation indicated is shown in Fig. 6.15(b), where each € on the right-hand 
side is obtained by sequential integrations of €. To form the output, we go back 
to Fig. 6.15(a) and note that 


Y(s) = b(s)£(s), (6.54) 
which means 
y = DE + bié + dé. (6.55) 


We again pick off the outputs of the integrators, multiply them by {b;}’s, and 
form the right-hand side of Eq. (6.49) by using a summer to yield the output, 
as shown in Fig. 6.15(c). In this case, all the feedback loops return to the point 
of application of the input, or "control," variable, and hence the form is referred 
to as the control canonical form. Reduction of the structure by Mason's rule or 
by elementary operations verifies that this structure has the transfer function given 
by H(s). 

Taking the state as the outputs of the three integrators numbered, by conven- 
tion, from the left, 


xi = €, to =, x3 = &, 


we obtain 
ži = = —ajx1— A2X2 — asxa + u, 
x? = Ws 
X4 = X», (6.56) 


or, in our matrix notation, 


—u€41 —G5 — 43 l 
E. = l 0 D I: G. =| 0]; 
0 l 0 0 
H. = [b; b2 b3]; Je =0. (6.57) 


The special structure of the system matrix is referred to as the (upper) companion 
form. The characteristic equation of such a system is a(s) = s? + ais? + aos - a3 
and has the property that its coefficients are the elements in the first row of F.. If 
we now form the closed-loop system matrix, Fe — G.K, we find that 


=a =k 90a hz s K3 
F. - G.K = l 0 0 ; (6.58) 
0 l 0 


By inspection [comparing Eq. (6.58) with Eq. (6.57)], the characteristic equation 
[Eq. (6.58)] is 


s? + (a4 + Kis? + (a2 + K5)s + (as + K3) = O. (6.59) 
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Therefore, if the desired pole locations result in the characteristic equation given 
by Eq. (6.43), 


a-(s) = s? + ais? + as +a = 0, (6.60) 


the necessary feedback gains can be found by equating the coefficients in Eqs. 
(6.59) and (6.60). This result is 


Kı = —aG, + Qı, K = —a2 + Q3, K3 = —a3 + a3. (6.61) 


We now have the basis for a design procedure: Given an arbitrary (F, G) and a 
desired characteristic polynomial a,(s), we transform (F, G) to control canonical 
form (F., G+) and solve for the control gains by inspection via Eq. (6.61). Since 
this gain is for the state in the control form, we must transform the gain back to 
the original state. (See Appendix 6C for a development of this method.) 

The fact that one can shift the poles of a system by state feedback to any 
desired locations is a rather remarkable result. However, we must pause and ask 
ourselves whether this can always be done. Equivalently, we ask ourselves if one 
can always transform (F, G) to the control form (F., G,). The answer is always 
"yes" if the system has a property called controllability. Roughly speaking, a 
system is “controllable” if the state can be moved in any desired direction by 
suitable choice of control signals. Equivalently, if the system is controllable, the 
roots of the system can be moved to any desired locations by state feedback. In 
rare instances, the system may be “uncontrollable,” in which case no possible 
control will yield arbitrary root locations. These systems have certain modes, or 
subsystems, that are unaffected by the control. This usually means that parts of 
the system are physically disconnected from the input. For example, the steering 
wheel of a car cannot be used to control the engine speed. Engine speed is not 
“controllable” by the steering wheel but it is controllable by the throttle. 

If there are no repeated roots of the system (that is, if the roots are “distinct’’), 
it is always possible to choose a realization (selection of state) so that each state 
variable represents a natural mode of the system. This means that the system can 
be represented as 


Àl O 81 

À2 82 
x = x+| . |i, (6.62) 

O Àn En 


which we refer to as the diagonal form. This form explicitly exhibits the criterion 
for controllability. All the elements in the input matrix G must be nonzero if the 
system is controllable. Otherwise, the modes corresponding to zero entries in G 
are not influenced by control, and the associated state variable will conform to 
their natural behavior. This would, of course, be a sad state of affairs if the un- 
controllable modes happen to be unstable. A good physical understanding of the 
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system being controlled would prevent any attempt to design a controller for an 
uncontrollable system. There are mathematical tests for controllability in Appendix 
6B, which are applicable to any state-space description that essentially evaluates 
G in Eg. (6.62), tests whether all elements are nonzero, and provides additional 
help in discovering this property. However, no mathematical test can replace the 
control engineer’s physical understanding of the system. This is especially true 
since often the physical situation is such that every mode is controllable to some 
degree, and, while the mathematical tests indicate the system is controllable, certain 
modes are so weakly controllable that control design is ineffective for all practical 
purposes. 

Airplane control is a good example of weak controllability of certain modes. 
In steady cruise, pitch plane motion x, is primarily affected by the elevator ôe 
and weakly affected by rolling motion x,. Rolling motion is mostly affected by the 
ailerons 6a. The state-space description of these facts is 


de 
da 


Xp 
X, 


MEET 
j 3x, 


*p 
X, 


F, € 
0 F. 


, 


where e represents the weak coupling from rolling motion to pitching motion and 
may result from trimming* during steady turning flight. 

A mathematical test of controllability for this system would conclude that pitch 
plane motion (and therefore altitude) is controllable by the ailerons as well as by 
the elevator! But physically, it is unreasonable to attempt to control an airplane's 
altitude by rolling the aircraft with the ailerons. 

In addition to the transformation method described, we have an alternative 
method for solving for the feedback gains of a controllable system: Ackermann's 
formula. This formula organizes the process of converting to (F., G,) and back 
again in a very convenient fashion. This rather elegant formula was derived by 
Ackermann (1972), and a proof can be found in Appendix 6C. The relation is 


K=[0 -:: 0 I1J€ ''ao,(F), (6.63) 
where 
€=(G FG FG ::: F"'!G] 


is the controllability matrix,’ n is the order of the system or the number of state 
variables, and a,(F) is defined as 


a-(F) = F" +a F"! -o;F"? +-::+a,I, (6.64) 


* A reference condition where the body axis accelerations are zero. 


* We should mention that the matrix should not be inverted explicitly, as it may be ill-conditioned. 
Rather Eq. (6.63) should be converted to solving linear equations by a numerically stable method such 
as gaussian elimination with pivoting. For large problems, other methods should be used (see Problem 
6.32). 
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EXAMPLE 6.9 


where the a;'s are the coefficients of the desired characteristic polynomial [Eq. 
(6.43)]: 


als) = s" as" ! oa, (6.65) 


Note that Eq. (6.64) is a matrix equation. 


Applying this formula to the undamped oscillator example, we find that 
a, = 4a, ar = 4e 


and therefore 


2 2 
ach) = 0 al E —«ag 1 + 408} o 1| | —4@g 303 | ° 
Furthermore, 
0 1 
«-16 reie |? 1] 
zi 0 1 
«2l 4), 
and finally 
T B 0 1|| 3eà 4o 
coun roto ff Sl R- 
Therefore 
K = [302 4ao], 
which is the same result as was obtained previously. inj 


Implementation of Ackermann’s formula for the design of single-input, single- 
output systems and more complicated systems is usually accomplished with a com- 
puter aid, such as MATLAB, CTRL-C, or MATRIX,. 

Generally speaking, Ackermann's formula starts to break down for systems 
of higher order than 6 or 7. The reason is that forming € is not a good idea 
from a numerical point of view. Even if the system is completely controllable, 
the columns of € tend to become nearly linearly dependent with finite precision 
arithmetic. Careful selection of units and scaling on the state variables and input 
should help the computation. For results of experiments with various feedback 
gain calculation techniques the reader is referred to Laub et al. (1985). Robust 
algorithms for pole placement are reported in Kautsky, Nichols and Van Dooren 
(1985), Misra and Patel (1989), and Minimis and Paige (1982). 


6.4 
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Selection of Pole Locations for Good Design 


The first step in the pole-placement design approach described in the last section 
is to decide on the closed-loop pole locations. When selecting pole locations, it 
is always useful to keep in mind that the control effort required is related to how 
far the open-loop poles are moved by the feedback. Furthermore, open-loop zeros 
attract poles, so considerable control effort is required to move a pole away from 
a nearby zero. Therefore a pole-placement philosophy that aims to fix only the 
undesirable aspects of the open-loop response will typically allow smaller control 
actuators than one that arbitrarily picks all the poles in some location without 
regard to the original open-loop poles. Sometimes, closed-loop pole locations are 
specified, as in aircraft flying qualities specifications. In this section, we discuss 
three techniques to aid in the pole-selection process. The first two approaches deal 
with pole selection without explicit regard for their effect on control effort. The 
third method (called optimal control, or symmetric root locus) was developed to 
specifically address the issue of achieving a balance between good system response 
and control effort. 


Dominant Second-Order 

The second-order transient with complex poles at radius w, and damping ¢ was 
discussed in Chapter 2. The rise time, overshoot, and settling time can be deduced 
directly from the pole locations. The closed-loop poles for a system can be chosen 
as a desired pair of dominant second-order poles, with the rest of the poles selected 
to have real parts corresponding to sufficiently damped modes so the system will 
mimic a second-order response with reasonable control effort. It is also necessary 
to be sure that the zeros are far enough in the LHP so as not to have any appreciable 
effect on the second-order behavior. A system with several lightly damped high- 
frequency vibration modes plus two “rigid-body” low-frequency modes lends itself 
to this philosophy. Here one can pick the low-frequency modes to achieve a desired 
wn and ¢ and increase the damping of the high-frequency modes, holding their 
frequency constant in order to minimize control effort. 


Prototype Design 

For higher-order systems, which cannot be usefully approximated as a perturbation 
on a second-order system, the situation is more complex. Furthermore, the variety 
of responses is too great for a catalog to be very useful.* What can be helpful is 
a selection of higher-order prototype responses with very particular characteristics 
against which systems can usefully be compared. There are several sets of these, 
of which the ITAE and the Bessel responses seem most relevant to control. 


*For one such catalog, see Elgerd and Stephens (1959). 
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TABLE 6.1 
Prototype response 
poles 


One prototype set of transient responses was worked out by Graham and Lath- 
rop (1953) to minimize the integral of the time multiplied by the absolute values 
of the error (ITAE)—that is, to minimize 


$ -| tle| dt. 
0 


The evaluation was done numerically, and the resulting pole locations and step 
responses are shown in Table 6.1(a) and Fig. 6.16, respectively, for a nominal 
cutoff frequency wo = 1 rad/s. 

For those applications where overshoot must be avoided altogether, the Bessel 
filter prototype can be considered. These transfer functions are given by 1/B,(s), 
where B,(s) is the nth-degree Bessel polynomial. The pole locations are given in 
Table 6.1(b), and the step responses are shown in Fig. 6.17. 

Comparing the transient responses shown in Fig. 6.16 with those shown in Fig. 
6.17, it is seen that the ITAE has some overshoot, whereas the Bessel prototype 
has almost no overshoot. However, the ITAE responses have a faster rise time com- 
pared with Bessel prototypes. Further insight into the two prototype designs can 
be gained from studying their frequency responses shown in Fig. 6.18. It shows 
that, given the same wo, the ITAE has a higher bandwidth for the same attenuation 


(a) ITAE transfer functions k Pole locations for wọ = 1 rad/s* 


s+1 
s + 0.7071 + j0.7071* 
(s + 0.7081)(s + 0.5210 + 1.068) 
(s + 0.4240 + j1.2630)(s + 0.6260 + j0.4141) 
(s + 0.8955)(s + 0.3764 + j1.2920) 
(s + 0.5758 + j0.5339) 
6 (s + 0.3099 + j1.2634)(s + 0.5805 + j0.7828) 
«(s + 0.7346 + j0.2873) 


AWN 


(b) Bessel transfer functions k Pole locations for wọ = 1 rad/s* 
l s +1 
2 s + 0.8660 + j0.5000* 
3 (s + 0.9420)(s + 0.7455 + j0.7112) 
4 (s + 0.6573 + j0.8302)(s + 0.9047 + j0.2711) 
5 (s + 0.9264)(s + 0.5906 + 70.9072) 


(s + 0.8516 + j0.4427) 
6 (s + 0.5385 + j0.9617)(s + 0.7998 + j0.5622) 
(s + 0.9093 + j0.1856) 


* Pole locations for other values of wo can be obtained by substituting s/w for s everywhere. 
* The factors (s + a + jb)(s + a — jb) are written as (s + a + jb) to conserve space. 


FIGURE 6.16 

Step response of ITAE 
prototypes for wo = 

| rad/s. 


FIGURE 6.17 

Step responses of the 
Bessel prototype systems 
for wọ = 1 rad/s. 
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FIGURE 6.18 
Frequency response 
magnitude of ITAE and 


Bessel prototype systems. 


—— ITAE 
= — — Bessel 


Magnitude ratio 


0.1 0.2 0.4 0.6 0.8 1 2 4 6 8 10 w,rad/s 


at higher frequencies. Therefore, by selecting wo to give the same bandwidths, one 
can achieve reduced sensitivity to sensor noise at high frequencies with the ITAE. 

Note that all the poles in a particular prototype response have similar natural 
frequencies. Therefore, direct application of a prototype design to a system with a 
large spread in the frequencies of its open-loop modes will likely result in excessive 
control usage. An alternative approach would be to use a prototype pole constella- 
tion for the lower-frequency portions of the system and simply add some damping, 
if required, to the higher-frequency portions. Examples of these approaches are 
found in Section 6.6. 


The Symmetric Root Locus 

A most effective and widely used design technique of linear control system design 
is the optimal linear quadratic regulator (LQR) design. The simplified version of 
the LQR problem is to find the control such that the performance index 


7 = | [pz^(t) + u*(r)] dt (6.66) 
0 


is minimized for the system 


x = Fx + Gu, 
z = Hix, (6.67) 
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where p in Eq. (6.66) is a weighting factor of the designer’s choice. It can be 
shown (see Chapter 5, Bryson and Ho, 1969) that the control that minimizes the 
$ in Eq. (6.66) is given by linear-state feedback 


u = —Kx, (6.68) 


where the optimal value of K is obtained as follows. It is shown in Kailath (1980) 
that the optimal closed-loop poles are given by the stable roots (those in the LHP) 
of the equation 


1 + pGo(—s)Go(s) = 0, (6.69) 
where Go is the open-loop transfer function, 


Go(s) = zs) = Hi(sI- F) !G = N(s) 


zs D (6.70) 


Note that this is a root-locus problem, as discussed in Chapter 4, with respect to 
the parameter p, which weights the “tracking error" z? versus the control effort u? 
in the performance index [Eq. (6.66)]. Note also that s and —s affect the equation 
in an identical manner; therefore, for any root so of the equation, there will also be 
a root at —59. We thus call the resulting root locus a symmetric root locus (SRL), 
and the locus in the LHP will have a mirror image in the RHP; that is, there is 
symmetry with respect to the imaginary axis. Selection of the optimal roots may 
thus be accomplished by first selecting the matrix Hı, which defines the "tracking 
error" and then choosing p, which balances the importance of tracking error against 
control effort. Notice that the output selected for this purpose does nor need to be 
the output measured and used for feedback. 

Solving Eq. (6.69) results in the desired closed-loop roots, which are then 
used in a pole-placement calculation such as Ackermann's formula [Eq. (6.63)] to 
obtain K. 

As with all root loci for real transfer functions Go, the locus is also symmetric 
with respect to the real axis, and thus there is the special double symmetry with 
respect to both the real and imaginary axes. The SRL equation can be written in 
the standard form, 


N(—s)N(s) . 


UT PERDU] 


0, (6.71) 
and it can be obtained by reflecting the open-loop poles and zeros of the plant 
across the imaginary axis (which doubles the number of poles and zeros), and 
then sketching the locus. Note that the locus could be either a 0? or 180? locus, 
depending on the sign of Go(—s)Go(s). A quick way to determine which type 
of locus (0? or 180°) is to pick the one that has no part on the imaginary axis. 
This is because the optimal closed-loop system is guaranteed to be stable, and 
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FIGURE 6.19 
Design-tradeoff curve for 
double-integrator plant. 


thus no segment of the locus can lie on the imaginary axis. Examination of the 
SRL can provide the designer with pole locations determined so as to achieve vary- 
ing balances (different p’s) between fast response and low control. Figure 6.19 
shows the design-tradeoff curve for the double integrator plant [Eqs. (6.3) and 
(6.4)] for various values of p ranging from .01 to 100. The tradeoff is between 
control energy (| u?dt) and the rate of decay of the output ([z?dt). The curve 
has two asymptotes (dashed lines) corresponding to low (large p) and high (small 
p) penalty on the control usage. In practice, usually a value of p corresponding 
to a point close to the knee of the tradeoff curve is chosen. This is because it 
provides a reasonable compromise between the use of control and the speed of re- 
sponse. For the double-integrator plant, the value of p = 0.71 corresponds to the 
knee of the curve. In this case the closed-loop poles have a damping ratio of 
¢ = 0.707! Figure 6.20 shows the associated Nyquist plot, which has a 
phase margin PM = 65° and infinite gain margin.* It is interesting to con- 
sider the limiting behavior of the optimal closed-loop poles as a function of 
the root-locus parameter (i.e., p) although, in practice, neither case would be 
used. 


* [t has been proved (Anderson and Moore, 1971) that the Nyquist plot for an LQR design avoids a circle 
of radius one centered at the —1 point. This leads to extraordinary phase and gain margin properties. 


FIGURE 6.20 
Nyquist plot for LOR 
design. 
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Imaginery 


“Expensive control" case (p — 0) Equation (6.66) penalizes output devia- 
tions as well as the use of control energy. If the control is expensive, the optimal 
control does not move any of the open-loop poles except for those that are in the 
right-half plane (RHP). The poles in the RHP are simply moved to their mirror 
images in the LHP. The optimal control does this to stabilize the system using 
minimum control effort and makes no attempt to move any of the poles of the 
system in the LHP. The closed-loop pole locations are simply the starting points 
on the SRL in the LHP. The optimal control does not speed up the response of the 
system in this case. For the double-integrator plant, the vertical dashed line in Fig. 
6.19 corresponds to the "expensive control" case. 


"Cheap control" case (p — œ) In this case, control energy is no object and 
may be used by the optimal control law. The control law then moves some of the 
closed-loop pole locations right on top of the zeros in the LHP. The rest are moved 
to infinity along the SRL asymptotes. If the system is nonminimum phase, some 
of the closed-loop poles are moved to mirror images of these zeros in the LHP. 
The rest of the poles go to infinity and do so along a Butterworth filter pole 
pattern. The optimal control law provides the fastest possible response time. The 
feedback gain matrix K becomes unbounded in this case. For the double-integrator 
plant, the horizontal dashed line in Fig. 6.19 corresponds to the "cheap control" 
case. 
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EXAMPLE 6.10 


EXAMPLE 6.11 


FIGURE 6.21 
Symmetric root locus for 
Example 6.10. 


Examples 6.10—6.12 illustrate the use of the SRL while examples of the use 
of dominant second-order and prototype design can be found in Section 6.6. 


Consider the first-order system 


ý = —ay +u, 


G(s) 
The SRL equation is 


Erf q^ 


The SRL is as shown in Fig. 6.21 and is a 0? locus. The optimal (stable) pole can 
be determined explicitly in this case as 


s=—Ja’+p. 


This result states that the closed-loop root location that minimizes the cost 
function of Eq. (6.66) lies on the real axis at the distance given above, which is 
always to the left of the open-loop root. EY 


Consider the unstable second-order system that corresponds to the inverted pendu- 
lum equation of motion: 
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Select an output equally weighted on position and velocity; that is, 


y -[1 1)x. 
We calculate from Eq. (6.70): 
si 
Go(s) — S ud 


and the symmetric loci are as shown as in Fig. 6.22. Two stable roots would 
be chosen for a given value of p and used for pole-placement and control-law 
design. g 


FIGURE 6.22 
Symmetric root locus for 
Example 6.11A. 


a»1 


a<l 
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FIGURE 6.23 
Symmetric root locus for 
Example 6.12. 


EXAMPLE 6.12 


Consider the second-order nonminimum phase system with 


(s — 1) 


00S) = C432 ji)’ 


The symmetric root locus is as shown in Fig. 6.23 (it is a 0? locus). For the 
expensive control case, the optimal closed-loop roots are at —2 + j1, that is, do 
not move. For the cheap control case, one of the poles is moved to —1, which 
is the location of the reflection of the zero in the RHP. The other pole moves to 
minus infinity along the real axis. ie 


6.4.1 Comments on the Methods 


These three methods of pole selection are alternatives that the designer can use 
for an initial design by pole placement. Note that the first two methods suggest 
closed-loop pole selection without regard to the effect on the control effort required 
to achieve that response. In some cases, therefore, the resulting control effort may 
be unreasonably high. The third method (SRL), on the other hand, selects poles 
that result in some balance between system errors and control effort. The designer 
can easily examine the relationship between shifts in that balance (by changing p) 
and system root locations, time response, and feedback gains. However, the SRL 
method does not provide direct specification of the transient shape in the way the 
other methods do. Whatever the initial pole-selection method, some modification 
is then made to achieve the desired balance of bandwidth, overshoot, sensitivity, 
control effort, or other design requirements. Further insight into pole selection will 
be gained from Example 6.16, given in Section 6.6. 


FIGURE 6.24 
Open-loop estimator. 


6.5 
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Estimator Design 


The control law designed in the last section assumed that all the state variables are 
available for feedback. In most cases, all the state variables are not measured. The 
cost of the required sensors may be prohibitive, or it may be physically impossible 
to measure all the state variables—for example, in a nuclear power plant. The 
purpose of this section is to demonstrate how to reconstruct all the state variables 
of a system from measurements of some of them. If the estimate of the state is 
denoted by &, it would be nice if the true state in the control law given by Eq. 
(6.39) could be replaced by its estimate, u = —KX. This is indeed possible, as 
we shall see in Section 6.6. 


6.5.1 Full-Order Estimators 


One method of estimating all the state variables that one may consider is to construct 
a model of the plant dynamics: 


& = FR + Gu, (6.72) 


where X is the estimate of the actual state x. We know F, G, and u(t), and hence 
this estimator is satisfactory if we can obtain the correct initial condition x(0) and 
set (0) equal to it. Figure 6.24 depicts this “open-loop” estimator. However, it 
is precisely the lack of information on x(0) that requires the construction of an 
estimator. Otherwise, the estimated state could track the true state exactly. Thus, if 
the initial condition was off, the estimated state would have a continually growing 
error or an error that goes to zero too slowly to be of any use. Furthermore, small 
errors in our knowledge of the system (F,G) would also cause the estimate to 
slowly diverge from the true state. 

To study the dynamics of this estimator, we define the error in the estimate as 


£2x-—$£. (6.73) 
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FIGURE 6.25 
Closed-loop estimator. 


The dynamics of this error system are given by 
k= FX, %0) = x(0) — &(0). (6.74) 


The error converges to zero for a stable system (F with all poles in LHP) because 
x and X are converging to zero, but the state estimates are not converging to the 
true state in a meaningful way. 

In order to speed up the process and provide a useful state estimate, we feed 
back the difference between the measured and estimated outputs and correct the 
model continuously with this error signal. This scheme is shown in Fig. 6.25, and 
the equation for it is 


Å = F& + Gu + L(y — HÈ), (6.75) 
where L is a proportional gain, 
L= [ly bey «dal (6.76) 


to be chosen to achieve satisfactory error characteristics. The dynamics of the error 
can be obtained by subtracting the € equation (Eq. 6.75) from the state equation 
(6.5), which results in 


X = (F - LH)Š + Giw. (6.77) 
The characteristic equation of the error is now given by 
det[sI — (F — LH)] = 0. (6.78) 


If L can (we hope) be chosen so that F — LH has stable and reasonably fast roots, € 
will decay to zero if there is no disturbing input w, irrespective of €(0). This means 
that X(t) will converge to x(t), regardless of the value of &(0), and, furthermore, 
the dynamics of the error can be chosen to be faster than the open-loop dynamics 
F. Note that Eq. (6.77) is only forced by one term, w. This is a consequence of 
assuming F, G, and H to be identical in the plant and estimator. Therefore, for 


Process 
(F,G) 

Model 
(F,G) 


EXAMPLE 6.13 
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w = 0, the estimation error X converges to zero and remains there, independent 
of any known forcing function u(t) on the plant and its effect on the state x(r). If 
we do not have a very accurate model of the plant (F, G, H), the dynamics of the 
error are no longer governed by Eq. (6.77). However, L can typically be chosen 
so that the error system is stable and the error is acceptably small, even with small 
modeling errors and disturbing inputs. It is important to realize that the nature of 
the plant and estimator are quite different. The plant could be a chemical process, 
whereas the estimator is an electronic unit or computer implementing the estimated 
state differential equation (Eq. 6.75). 

The selection of L can be approached in exactly the same fashion as the 
selection of K is in the control-law design. If we specify the desired location of 
the estimator error roots as 


^. m Bi, re -T 
the desired estimator characteristic equation is 
ae(s) 5 (s — Bis — pa (s — Bn) = 0, (6.79) 


and one can solve for L by comparing coefficients in Eqs. (6.78) and (6.79). 
However, this can only be done if the system is “observable.” Roughly speaking, 
observability refers to the ability to deduce information about all the modes of 
the system by monitoring the sensed outputs. Unobservability results from some 
mode or subsystem being disconnected physically from the output and therefore 
not appearing in the measurements. For example, if only derivatives of certain 
state variables are measured, and these state variables do not affect the dynamics, 
a constant of integration is obscured. This situation occurs with a 1/s? plant if only 
velocity is measured, for then it is impossible to deduce the initial value of the 
position. On the other hand, for an oscillator a velocity measurement is sufficient to 
estimate position because the acceleration, and consequently the velocity observed, 
are affected by position. The mathematical test for determining observability is 
developed in Appendix 6A. The result is that the observability matrix, 


H 


must be full-rank. 


Again, consider the undamped oscillator with frequency wo: 


x = F [x+ 
w 
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Suppose we wish to place the estimator error equation at — 10a (five times as fast 
as the state feedback controller poles); then 


ae(s) = (s + 10w) = s? + 20wos + 100w/. 


From Eq. (6.78), 


det[sI — (F — LH)] = s? + lis +1. +}. 


Comparing coefficients in the above two equations, we find that 


B 
l2 


L= 


20w | 


992 (6.80) 


FIGURE 6.26 
Undamped-oscillator initial-condition response of y and f. 


FIGURE 6.27 
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This completes the design of the estimator (Eq. 6.75) for this example. The overall 
system equations are obtained by substituting u = —KX and y = Hx in Eqs. 
(6.5) and (6.75). Combining these two equations in matrix notation results is 


i] [F -GK x 
$ ^ LH F-LH-GK &|' 
y -[H 0] (6.81) 


The response of the above closed-loop system with wọ = 1 to an initial condition 
xo = [0.3, —0.5]! is shown in Figs. 6.26 and 6.27, where K is obtained from Eq. 
(6.48) and L from Eq. (6.80). Note that the state variable estimates track the ac- 
tual ones after an initial transient, and the error between them decays approximately 


Undamped-oscillator initial-condition response of y and y i 


FTIN 


0.5 


1.0 


1.5 2.0 2.5 3.0 3.5 4.0 
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FIGURE 6.28 
Comparison of control 
efforts for state and 
estimated state feedback. 


five times faster than the decay of the state itself. The estimator had an initial 
condition of ĝo = [0,0]T. The control effort is shown in Fig. 6.28. The control 
effort with full-state feedback is also shown for comparison. The control effort of 
the controller-estimator is initially much different because of the initial uncertainty 
in the state. al 


Observer Canonical Form 

As in the controller design, there is a canonical form for which the estimator 
design equations are particularly simple. Consider again the third-order system in 
Eqs. (6.49) and (6.50). (The development is the same for higher-order systems.) 
Assume that both u and y signals are “available.” Then from Eq. (6.49), we can 
solve for the terms that have no differentiation as follows: 


bzu — a3y =y tajy + ary — bou — bjü. (6.82) 


If we form the left-hand side as shown in Fig. 6.29(a) and integrate the results, 
the output of the integrator is 


y t ayy — bu + ary — bau. 
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FIGURE 6.29 
Derivation of observer 
canonical form. 


V+ayj+agy—bou-byt 


y*ajy—b1X 


(b) 
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Since both u and y are available, the last two terms can be nulled by adding 
—azy + b; to the integrator output, as shown in Fig. 6.29(b). If we integrate the 
results one more time, the output of the second integrator is 


y To diy — biu. 


Again, we can add —a ,y + b,u to the output of the integrator, as shown in 
Fig. 6.29(c), to get y. Finally, y is integrated to yield y, and the realization is com- 
plete. If we take the state as outputs of the integration going from right to left, 
then 


Xo = E xs T Gou, 


y = Hoxo, (6.83) 
where 
—a, 1 0 bi 
Fo =| —a. O 1|, Go =| b5|, Ho =[1 0 0]. (6.84) 
—a3 0 0 b3 


In this realization, all the feedback loops come from the output or “observed” 
signal, and we call this structure the observer canonical form. It is a “direct” 
canonical form because the gains of the blocks in the structure are obtained directly 
from the coefficients of the numerator and denominator polynomials in the transfer 
function H(s), just as with the control canonical form. 

One of the advantages of the observer canonical form is that the estima- 
tor gains can be obtained from it by inspection. The estimator error closed-loop 
matrix is 


=g M li 1 0 
F» — LH, =| -a2-—7/2 O 1|, (6.85) 
43 > l5 0 0 
which has the characteristic equation 
s? + (ay + 1))s? + (az + l2)s + (a3 + 13) = 0, (6.86) 


and the estimator gain can be found by comparing the coefficients of Eq. (6.86) 
with a,(s). 

As in the controller design, an alternative method of computing L is to use 
Ackermann’s formula in estimator form, which is 


0 
0 
L=a,(F)O"'| . |, (6.87) 


TABLE 6.2 
Duality between Control 
and Estimation 
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Control Estimation 


F FT 
G H' 
H G! 
where 
H 
HF 
gc 
HF" -] 


is the observability matrix. 


Duality 

The reader may already have seen some resemblance between the estimation and 
control problems. In fact, the two problems are mathematically equivalent. This 
property is called duality, and Table 6.2 shows the duality relations between the 
estimation and control problems. For example, Ackermann's control formula (Eq. 
6.63) becomes the estimator formula (Eq. 6.87) if the substitutions of Table 6.2 are 
made. Furthermore, duality allows one to use the same design tools for estimator 
problems as for control problems, with proper substitutions. The two canonical 
forms, that is, the control and observer forms are dual, as seen from comparison of 
the triples (F., G., H.) and (Fo, Go, Ho). Basically, the role of input and output are 
interchanged. If in the observer form, starting from the output, all signal flows are 
reversed — the summers are changed to nodes and nodes are changed to summers — 
we obtain the control canonical form. Using the same rules, one can obtain the 
observer form from the control form. 


6.5.2 Reduced-Order Estimators 


The estimation design in the previous section reconstructs the entire state vector 
using measurements of some of the state variables. If the sensors have no noise, 
there seems to be a certain redundancy, and one may become curious as to the 
necessity of estimating state variables that are measured directly. Can we reduce 
the complexity of the estimator using the state variables that are measured di- 
rectly and exactly? Yes. However, it is better to implement a full-order estimator 
if there is significant noise on the measurements because the estimator filters the 
measurements in addition to estimating unmeasured state variables. 

The reduced-order estimator reduces the number of required integrators by the 
number of sensed outputs. To derive this estimator (Gopinath, 1971), we partition 
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the state vector into two parts: one part Xa, which is directly measured (x, = y), 
and another part x,, representing the remaining state variables that need to be 
estimated. If we partition the system matrices accordingly, the complete description 
of the system is given by 


Xa = ba Fab Xa +16 u 
Xp Fa Foo || Xp G,| ' 
y -[I 0]| **|. (6.88) 
Xp 
The dynamics of the unmeasured state variables are given by 
Xp = Fy,Xp + FogXq + Gu, (6.89) 
U ed 


known input 


where the rightmost two terms are known and can be considered as an input into 
the x, dynamics. Since x, = y, the measured dynamics are given by the scalar 
equation 


ža = y = Faay + Faoxy + Gau. (6.90) 
If we collect the known terms of Eq. (6.90) on one side, 
y — Faay — Gau = FapXp, (6.91) 
known measurement 


we obtain a relationship between known quantities on the left-hand side, considered 
as measurements, and unknown state variables on the right. Therefore, Eqs. (6.90) 
and (6.91) have the same relationship to the state x, that the original equation 
(Eq. 6.88) had to the entire state x. Following this line of reasoning, we can 
establish the following substitutions in the original estimator equations to obtain a 
(reduced-order) estimator of Xx»: 

X €— Xp, 

F — F, 

Gu — Fpay + Gpu, 

KT y F Faay — Gau, 

H — Fab. 
Therefore, the reduced-order estimator equations are obtained by making the sub- 
stitutions above in the full-order estimator (Eq. 6.75): 

&, = Fook) + Fray + Gou + L( — Faa y — Gau — Fass). (6.92) 
ita À— 


input measurement 


FIGURE 6.30 
Reduced-order estimator 
structure. 
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If we define the estimator error as 
35 = Xp, (6.93) 
the dynamics of the error are given by subtracting Eq. (6.92) from Eq. (6.89): 
X, = (Fos — LF;))&;. (6.94) 
Its characteristic equation is given by 
det[sI — (F,, — LF,;)] = 0. (6.95) 


We design the dynamics of this estimator by selecting L so that Eq. (6.95) matches 
a reduced order a,(s). Equation (6.92) can be rewritten as 


$p = (Fpp — LF;;)]&; + (Fpa — LFaa)y + (Gp — LG;)u + Ly. — (6.96) 


The fact that we must form the derivative of the measurements in Eq. (6.96) 
appears to present a practical difficulty. It is known that differentiation amplifies 
noise, so if y is noisy, the use of y is unacceptable. To get around this difficulty, 


we define the new controller state as 
x, $$, — Ly. (6.97) 


Then, in terms of this new state, the implementation of the reduced-order estimator 
is given by 


X, = (Fpp — LFab)ĝo + (Poa — LFaa)y + (Gp — LGo)u, (6.98) 


and y no longer appears directly. A block-diagram representation of the reduced- 
order estimator is shown in Fig. 6.30. 
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EXAMPLE 6.14 


The reduced-order estimator gain can also be found from Ackermann's formula 
(Eq. 6.87), with appropriate substitutions from Eq. (6.95): 


0 
0 
L = o4(F,)0;!| .|, (6.99) 


where 
Fab 
FaoF os 
0, — F,F;, 


X 
Fark, 


We should point out that the conditions for the existence of the reduced-order 
estimator are the same as for the full-order estimator—namely, observability 
of (F, H). 


Again, consider the undamped oscillator 


G -1 
—a 0 


0 
l 


xj 
X2 


X] 
X2 


X] 


u, yv p a] m 


Suppose we would like to place the roots of the reduced-order estimator-error 
characteristic equations at — 10co. The partitioned matrices are 


Faa Fab 0 j| = pe i 
Sigi 


Fa Fob -ej 0|' G, 
From Eq. (6.95), we find the characteristic equation in terms of L: 


$ —(0— L) * D. 


We compare it with the desired equation, 
a-(s) = s + 10o9 = O, 
which yields 
L = 10a. 
The estimator equation is, from Eq. (6.98), 
že = — 10w02: — wey Tu, 
and the state estimate, from Eq. (6.97), is 


$5 = xe + 10woy. 


FIGURE 6.31 
Initial-condition response 
of reduced-order 
controller. 
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The control law is from Eqs. (6.39) and (6.48) where x, is measured directly and 
x2 is used for x2. The response of the closed-loop system to an initial condition 
xo = [0.3, —0.5]' is shown in Fig. 6.31, and the control effort is shown in 
Fig. 6.32. The estimator had an initial condition xeo = 0 and wọ = 1. Note the 
similarity of the initial-condition response and control effort to that of the full-order 
estimator in Figs. 6.26, 6.27, and 6.28. un 


6.5.3 Estimator-Pole Selection 


The selection of estimator pole locations can be based on the techniques discussed 
in Section 6.4. As a rule of thumb, the estimator poles can be chosen by a factor of 
2 to 6 times faster than the controller poles. This is to ensure a faster decay of the 
estimator errors compared with the desired dynamics, thus causing the controller 
poles to dominate the total response. If sensor noise is large enough to be a major 
concern, one may decide to choose the estimator poles to be slower than 2 times 
the controller poles, which would yield a system with lower bandwidth and more 
noise-smoothing. However, the total system response in this case could be strongly 
influenced by the location of the estimator poles. If the estimator poles were slower 


Time, s 
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FIGURE 6.32 
Control effort for 


reduced-order controller. 


than the controller poles, the system response to disturbances would be dominated 
by the estimator dynamic characteristics. 

In comparison with the selection of controller poles, there is a much different 
relationship to control effort to be concerned with. As in the controller, there is a 
feedback term in the estimator that grows in magnitude as the speed of response 
increases. This feedback is in the form of an electronic signal or a digital word in a 
computer, but its growth causes no difficulty. In the controller, increasing the speed 
of response, and thus the control effort, implies the use of a larger actuator, which 
increases size, weight, and cost. The important consequence of increasing the speed 
of response of an estimator is that the bandwidth of the estimator becomes higher, 
thus causing more sensor noise to pass on to the control actuator. Thus, similar 
to controller design, the best estimator design is a balance between good transient 
response with low enough bandwidth so that sensor noise does not significantly 
affect actuator activity. 

In optimal estimation theory (Bryson and Ho, 1969), it has been shown that 
the best balance is dependent on the ratio of sensor noise to disturbance input 
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noise (w in Eq. 6.5). This is best understood by reexamining the estimator formula 
(Eq. 6.75), 


& = F& + Gu + L(y — HÌ), (6.100) 
and how it interacts with the system equations (Eq. 6.5), 
X = Fx + Gu + Gw, (6.101) 
and the measurement equation, 
y = Hx + vy, (6.102) 


where v is the measurement noise. The question to be addressed is how much 
the state estimate revision (X in Eq. 6.100) should be based on the system model 
(FX + Gu) versus the measurement error [L(y — HX)]. If the sensor noise v is 
relatively large, it is better to base the estimate more heavily on the model, and 
thus L should be small, which produces a slow estimator. If the input disturbance 
noise is relatively large, the system model in the estimator is less useful, and 
it is more important to believe the measurements. Thus L should be large and 
the estimator fast. The optimal solution to this balance is achieved by solving an 
estimator symmetric root-locus equation that is almost identical to the SRL equation 
established for the optimal control formulation, Eq. (6.69) (Kailath, 1980): 


1+ qG.(—s)G,(s) = 0, (6.103) 
where q is the ratio of input disturbance noise to sensor noise and 
G.(s) = H(sI - F) !G;. 


Note that G,(s) is similar to the Go(s) in Eq. (6.69). It differs in that G,(s) is the 
transfer function from the input disturbance (G, instead of G in Eq. 6.101) to the 
measurement, whereas Go is the transfer function from the control input to output 
for minimization in Eq. (6.66), that is, H; instead of H. 

The use of the estimator SRL, Eq. (6.103), is identical to the use of the 
controller SRL. A root locus versus q is generated, thus yielding sets of optimal 
estimator poles. The designer then picks the set of (stable) poles that seems best 
considering all aspects of the problem. An important advantage of using the SRL 
technique is that the arbitrariness is reduced to one degree of freedom (q) instead of 
the many degrees of freedom required to select the poles directly in a higher-order 
system. 

A final comment concerns the reduced-order estimator. Because of the presence 
of a direct transmission term (see Fig. 6.30), the reduced-order estimator has a much 
higher bandwidth from sensor to control compared with the full-order estimator. 
Therefore, if sensor noise is a significant factor, the reduced-order estimator is 
less attractive, since the potential savings in complexity is more than offset by the 
increased sensitivity to noise. 
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6.6 


Compensator Design: Combined Control Law and Estimator 


If we take the control (Section 6.3) and implement it using the estimated state 
variables, the design for a regulator (no reference input to be tracked) is complete. 
However, since we designed the control law assuming that all the state variables 
were available, we may wonder (and need to compute) what effect using X in place 
of x has on the system dynamics. The plant equation with feedback is now 


x = Fx - GKX, (6.104) 
which can be rewritten in terms of the state error X as 
x = Fx — GK(x - X). (6.105) 


The overall system dynamics are obtained by combining Eq. (6.105) with the error 
equation (Eq. 6.77), which, in overall state form, is 


x| |F-GK GK X 
$ ^| 0 F-LH|&i| (5.106) 
The characteristic equation of the closed-loop system is 
sI— F + GK -GK S 
det 0 SI-F- " = 0. (6.107) 


which, because it is block triangular (see Appendix C), can be written as 
det[sI — F + GK] det[sI — F + LH] = a.(s)a,.(s) = 0. (6.108) 


In other words, the poles of the combined system consist of the union of the control 
roots and the estimator roots. This means that the design of the control law and the 
estimator can be carried out independently; yet, when they are used together the 
roots are unchanged. This is a special case of the separation principle (see Gunkel 
and Franklin, 1963), which holds in much more general contexts and allows for 
separate design of control law and estimator in certain stochastic cases. 

To compare the state-variable method of design with the transform methods 
discussed in Chapters 4 and 5, we note from Fig. 6.33 that the dashed portion 
corresponds to a compensator. The state equation for this compensator is obtained 


by including the feedback law u = —KX (since it is part of the compensator) in 
the estimator equation (Eq. 6.75): 
$ = (F — GK - LH)& + Ly, u = —K&, (6.109) 


which is the same form as Eq. (6.17): 
x = Fx + Gu, (6.110) 
which was shown in Eq. (6.29) to have a characteristic equation 


det[sI — F] = 0. (6.111) 


FIGURE 6.33 
Estimator and controller 
mechanization. 
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Process 


x=Fx+Gu 


Control law Estimator 


& =Fx+Gu 
-K + L(y- H&) 


Therefore, the characteristic equation of the compensator is found by com- 
paring Eqs. (6.109) and (6.110) and substituting the equivalent matrices in Eq. 
(6.111): 


det[sI — F + GK + LH] = 0. (6.112) 


Note that the roots of Eq. (6.112) were never specified nor used during the state- 
space design technique. (Note also that the compensator is not guaranteed to be 
stable.) The transfer function representing the dynamic compensator is obtained by 
inspecting Eq. (6.21) and substituting in the similar matrices from Eq. (6.108). 
This yields 


D(s) = ^ Em —K[sI — F + GK + LH] !L. (6.113) 


The same development can be carried out for the reduced-order estimator. In that 
case, the control law is 


u = ed fo K, | = —E ay — K,Xp. (6.114) 


Xa 
Xp 
Substituting Eq. (6.114) into Eq. (6.98) and using Eq. (6.97), we obtain 

X. = A,X, + B,y, 

u = C,x,. + D,y, (6.115) 


where 


Fsb — LF,, — (Gs — LG,)Ky, 

A,L + Fpa — LF;4, — (Gp — LG;)K;, 

-K,, 

-K, — KoL. (6.116) 


~ 


vapp 
Il 


~ 
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EXAMPLE 6.15 


The dynamic compensator now has the transfer function 


D(s) = YG = C,(sI— A,) !B, + D,. (6.117) 


When we compute D(s) for a specific case, we will find that they are very similar 
to the classical compensators of Chapters 4 and 5, in spite of the fact that they are 
arrived at by entirely different means. Examples 6.15 and 6.16 illustrate state-space 
design. 


Consider the double integrator plant 
l 
G(s) = ri 


with state-variable Eqs. (6.3) and (6.4): 


: 0 1 0 
x = 0 o|** l u, 
y=[1 Olx. 


If we place the controller roots at s = —( JHD Ert J2/2)(o, = a, ¢ = 0.7), 
then 


a-(s) = s? + Js +1. (6.118) 
The state feedback gain is then found to be 


K=[1 2]. 


If the estimator-error roots are at o, = 5, ¢ = 0.5, the desired estimator charac- 
teristic polynomial is 


a(s)=s?+5s+25=5+2.5+ j4.3, (6.119) 


and the estimator feedback gain matrix is 


.-|51 


The compensator transfer function given by Eq. (6.113) is 


—40.4(s + 0.619) 


Dis) = T1321 + ATT’ 


(6.120) 
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which looks very much like a /ead compensator in that it has a zero on the real 
axis to the right of its poles; but, rather than one real pole, it has two complex 
poles. The zero provides the derivative feedback and the double pole provides 
some smoothing of sensor noise. The effect of the compensation on the system 
closed-loop roots can be evaluated in exactly the same way that compensation was 
evaluated in Chapters 4 and 5 using root-locus or frequency-response tools. The 
gain of 40.4 in Eq. (6.120) is a result of the root selection inherent in Eqs. (6.118) 
and (6.119). If we replace this specific value of gain with a variable value K, the 
characteristic equation of the closed-loop system becomes 


K(s ar) B (6.121) 

(s + 3.21 + j4.77)s? 
The root-locus technique allows us to evaluate the roots of this equation versus K, 
and this is done in Fig. 6.34. Note that the loci go through the roots selected in 
Eqs. (6.118) and (6.119), and, when K = 40.4, the four roots of the closed-loop 
system are equal to those specified. 

The frequency-response plots seen in Fig. 6.35 show that the compensation 
designed using state-space accomplishes the same results that one would strive for 
using frequency-response design. Specifically, the uncompensated phase margin 
of 0? is increased to 53? in the compensated case, and the gain of K — 40.4 pro- 
duces a crossover frequency of 1.35 rad/s. Both these values are roughly consis- 
tent with the controller closed-loop roots, with w, = 1 rad/s and 4 = 0.7, as 
one should expect since these slow roots are more dominant in the system 
response than the estimator. 

Consider designing a reduced-order estimator for the system. If we choose to 
place the single estimator pole at —5, then, from Eq. (6.95), 


L — 5. 


The scalar compensator equations are 


—Dlx.-— 35413; 
= Lal, m 8.075, 


Xc 


= 
Il 


where 
Xo = $2— 5y. 


The compensator is shown in Fig. 6.36 and has the transfer function given by 
Eq. (6.117): 


—8.07(s + 0.62) 


sa ae TF 
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Im(s) 
FIGURE 6.34 
Root locus for the 
combined control 
estimator, with process 
gain as the parameter. 6 


Re(s) 


The reduced-order compensator is precisely the lead network that was described 
in Chapters 4 and 5. This is a pleasant discovery, as it shows that classical and state- 
variable techniques can result in exactly the same type of compensation. The root 
locus of Fig. 6.37 shows that the closed-loop poles are at the assigned locations, 
and the frequency response of the compensated system seen in Fig. 6.38 shows a 
phase margin of about 55°. As with the full-order estimator, analysis by the other 
methods confirms the selected root locations. | 
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FIGURE 6.35 
Frequency response for 1/s? example. 
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FIGURE 6.36 

Simplified block diagram 
of a reduced-order 
controller, a lead 
network. 
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FIGURE 6.37 

Root locus of a reduced- 

order controller and 1/s? 

process. Root locations at 
= 8.07 are shown by 

the dots. 


FIGURE 6.38 
Frequency response of the 1/s? example with a reduced-order estimator 
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EXAMPLE 6.16 


FIGURE 6.39 
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Consider the third-order system 


10 


Gi) — x 36s 8D 


A block diagram representation of this system in observer canonical form is shown 
in Fig. 6.39. The corresponding state-variable matrices are 


=10 1 9 0 
F-/|-16 0 1|, G =| 0], 
0 0 0 10 

H=([1 0 0] J =0. 


Suppose we want the state feedback poles to be at the third-order ITAE locations, 
with wọ = 2. From Table 6.1(a), we let s be replaced by s/2, clear fractions, and 
compute 


a-(s) = (s + 1.42)(s + 1.04 + 72.14) 


= s? + 3.557 + 8.65 + 8. 
By comparing coefficients of œ. with the control characteristic equation 
det[sI — F + GK] = a,(s), 
the state feedback gain is found to be 
K = [-46.4 5.76 —0.65]. 


If we wish to place the full-order estimator poles at the third-order ITAE locations, 
with wọ = 6, we compute 

(s + 4.25)(s + 3.13 + j6.41) 

s? + 10.55? + 77.45 + 216. 


a(S) 


Third-order example in observer canonical form. 
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FIGURE 6.40 
Root locus for ITAE pole 
assignment. 


By comparing coefficients in the estimator characteristic equation 
det[sI — F + LH] = a,(s), 
the estimator gain is found to be 


0.5 
L =| 61.4 
216 


The compensator transfer function as given by Eq. (6.113) is 


(s + 0.432)(s + 2.10) 


Day = «je d 
(s) 9G — 1.885 + 2.94 + j8.32) 


Figure 6.40 shows the root locus of the system. It verifies that the roots are in the 
ITAE locations specified, in spite of the peculiar compensation that results. 

Note that the compensator has an unstable root at s = +1.88 but that all sys- 
tem closed-loop roots (controller and estimator) are stable. Compensators are not 
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typically designed this way because of the difficulty in testing the compensator 
by itself in a bench checkout. In some cases, however, better control can be achieved 
with an unstable compensator, and its inconvenience in checkout may be worthwhile. 

Figure 6.40 also shows that the system is conditionally stable in that the system 
is unstable for small values of gain. Therefore, if the gain of any part of the system 
was to take on a smaller than nominal value during startup, the system would be 
unstable. This type of situation is considered less desirable than one where the 
system is stable for all values of gain lower than the nominal value. 

If, instead of the full-order estimator, we design a reduced-order estimator, 
with estimator poles at the second-order ITAE locations and with wọ = 6, that is, 
at —4.2 + 74.28, the desired estimator characteristic polynomial is 


a.(s) = s? + 8.4s + 36. 


Following the partitions, 


Fa i Fab MS P 1 = us is Ga i 
ae Ss a Ba a ae ICM) 
Fa | Fp, 0 '0 0 G, l 


and solving for the error characteristic polynomial, 
det[sI — F,, + LF,,] = o.(s), 


we find that 


L= 


8.4 
36 | 


The compensator transfer function is given by Eq. (6.117) and is computed to be 


(s —0.718Ys + 1.87) 


Dis) = 21.416 
(s) s +0.95 + j6.17 


The associated root locus for this system is shown in Fig. 6.41. Note that this is a 
non-minimum phase compensator and a zero-degree root locus. 

As an alternative to placing poles using the ITAE criterion, consider using the 
symmetric root locus for this problem. The symmetric root locus for the system 
is as shown in Fig. 6.42. If we assume that G; = G and H, = H, the SRL 
is the same for the controller and estimator, and one only needs to be generated. 
Suppose we select —2 + /1.56 and —8.04 as the desired state feedback poles and 
—4 + j4.9 and —9.169 as the estimator poles. The feedback gain is 


K = [-0.275 0.218 0.204] 
and the estimator gain is 


Jd 
L-^| 97.5 
368 
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FIGURE 6.41 
Root locus for an ITAE 


reduced-order controller. 


FIGURE 6.42 
Symmetric root locus. 
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Root locus for optimum 
pole assignment. 


6.6 / Compensator Design: Combined Control Law and Estimator 423 


Notice that the feedback gains are much smaller than those required for ITAE 
placement. The resulting compensator transfer function is given by Eq. (6.113), 


—94.5(s + 7.98)(5 + 2.52) 


Ds) = 3-428 + j642yG + 10.6) 


and the root locus of the closed-loop system is shown in Fig. 6.43. It shows the 
same closed-loop locations as those selected from the SRL, as it should. Note that 
the compensator is now minimum phase. This improved design comes about in 
large part because the root at s = —8 is virtually unchanged. It doesn’t need to 
be changed for good performance; in fact, the only feature in need of repair in the 
original G(s) is the root at s = 0. The SRL technique essentially discovered that 
the best use of control effort is to shift the two low-frequency roots at s = 0, —2 
and to leave the s = —8 root alone. 

Armed with this knowledge, let's go back, with a better selection of poles, and 
investigate the use of pole placement for this example. Initially we used the third- 
order ITAE locations, which produced three poles with a natural frequency around 
2 rad/s. This violated the principle that open-loop poles should not be moved unless 
they're a problem. (The pole at s = —8 was moved to s = — 1.4.) Let's try it 


| 
 — c— PH 
| 


rol 
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6.7 


again, but we'll only use ITAE (second-order) to shift the slow poles, and we'll 
leave the fast pole at s — —8; that is, 


a-(s) = (s t 1.41 + j1.41)(s + 8). 
We find that the required feedback gain is 
K = [-0.469 0.234 0.0828], 


which has a smaller magnitude than the case where the pole at —8 was moved. It 
is also interesting to note that the SRL yields a feedback gain that is much smaller 
in magnitude than either pole-placement alternatives. If we select 


a.(s) = (s + 4.24 + j4.24)(s + 8), 
the estimator gain is found to be 


6.48 
L=| 87.9 |, 
288 


and the compensator transfer function is 


—41.4(s + 2.78)(s + 8) 


Did E ————— e 
(5) = ($4.13 + j5.29)s + 9.05) 


which is stable and minimum phase. This example illustrates the value of judicious 
pole selection and of the SRL technique. The poor pole selection inherent to the 
initial use of the third-order ITAE results in higher control effort and produces 
an unstable compensator. Both these undesirable features are eliminated by use of 
SRL or improved pole selection. E 


Introduction of the Reference Input 


The controller obtained by combining the control law studied in Section 6.3 and 
the estimator of Section 6.6 is essentially a regulator design. This means that 
the characteristic equations of the control and estimator are chosen so as to give 
satisfactory transients to disturbances such as w(t), that is, disturbance rejection. 
However, no mention is made of a reference input or of design considerations to 
yield good transient response with respect to command changes, that is, command 
following. In general, both of these considerations should be taken into account 
in the design of a control system. This can be done by proper introduction of the 
reference input into the system equations. 


FIGURE 6.44 

Possible locations for the 
introduction of command 
input: (a) compensation 
in the feedback path; 

(b) compensation in 

the feed-forward path. 
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Let’s repeat the plant and controller equations for the full-order estimator (the 
reduced-order case is the same in concept, differing only in detail): 


x = Fx + Gu 
| plant; (6.122) 
y = Hx 
& = (F - GK - LH) + Ly | controller. (6.123) 
u = -KÅ 


Figure 6.44(a) and (b) shows the system with two possibilities for introducing 
the command input r. In general terms, they are similar to the issue of whether the 
compensation should be put in the feedback or feed-forward paths. The response of 
the system to command inputs is different, depending on the configuration, because 
the zeros of the transfer function are different. The closed-loop roots are identical, 
however, as can be easily verified by letting r = 0 and noting that the systems are 
then identical. 

The difference in the response of the two configurations can be seen quite eas- 
ily. Consider the effect of a step input in r. For the configuration in Fig. 6.44(a), 
the step will excite the estimator in precisely the same way that it excites the plant; 
thus the estimator error will remain zero during and after the step. This means 
that the estimator dynamics are not excited in the configuration of Fig. 6.44(a), 
and therefore the transfer function from r to y must have zeros at the estimator 


(a) 


Lm. 


(b) 
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roots in order to cancel the estimator roots. Therefore, a step command will excite 
system behavior consistent with the control roots above, that is, with roots of 
det[sI — F + GK] = 0. 

In the configuration seen in Fig. 6.44(b), a step command in r only enters 
directly into the estimator, thus causing an estimation error that settles out with 
the estimator dynamic characteristics. Thus a step command will excite system 
behavior consistent with both control plus estimator roots, that is, the roots of 
det[sI — F + GK] det[sI — F + LH] = O. It is therefore typically superior to 
command the system by the configuration shown in Fig. 6.44(a). 

A more detailed treatment of this issue is covered in the next section. The 
idea is developed that the command input can be introduced in both locations, and 
therefore the zeros, as well as the poles, of the transfer function can be arbitrarily 
selected. 


O 6.7.1 Servodesign 


Given a reference input r(t), the most general linear manner to introduce r to the 
system equations is to add terms proportional to it in the controller equations. We 
can do this by adding a term Nr to the control equation for u and a term Mr to the 
estimator equation. Note that N is a scalar and M is an n X | vector in this case. 
With these additions, the controller equations become 


& = (F- GK - LH)&+ Ly + Mr, 
u = -K + Nr. (6.124) 


Since r(t) is an external signal, it is clear that neither M nor N affects the charac- 
teristic equation of the combined controller-estimator system. In transfer-function 
terms, the selection of M and N will only affect the zeros of transmission from r to 
y and as a consequence can have a significant effect on the transient response but 
no effect on stability. The question then is: How can we choose M and N to obtain 
satisfactory transient response? We should point out that we assigned the poles of 
the system by feedback gains K and L and are now adding zeros by feed-forward 
control gains M and N. 
The selection of M and N can be based on the following four choices: 


1. Select M and N so that the state estimator-error equation is autonomous, that 
is, independent of r. 


2. Select M and N so that only the tracking error, e = (r — y), is used in the 
control. 


3. Select M and N to give the designer maximum freedom in setting the dynamic 
and static response of the system. 
4. Select M and N so as to minimize 


oc 
ming = | el e dt, 
0 
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the integral-squared tracking error. The algebra for the selection of M and N 
via the fourth method is rather involved and is omitted (see Emami-Naeini 
and Franklin, 1982). This method is a member of a class of computer-selected 
controller parameters. In the sequel, we shall discuss Cases 1-3. 


Case 1 From the viewpoint of estimator performance, the first of these methods 
is quite attractive. If & is to generate a good estimate of x, then surely € should 
be free of external excitation (that is, it should be “uncontrollable” from r). The 
computation of M and N is quite easy in this case. The estimator-error equation is 
found by subtracting Eq. (6.75) from Eq. (6.40), with the plant output substituted 
into the estimator equation and the control law substituted into the plant equation. 
The result is 


x — Å = Fx + G(-K$ + Nr) - (F- GK - LW)& + Ly — Mr, 
X = (F- LH)x + GNr — Mr. (6.125) 
If r is not to appear in Eq. (6.125), we should choose 
M = GN. (6.126) 


Since N is a scalar, M is fixed to within a constant factor. Note that with this choice 
of M we can write the controller equation as 


u = —K& + Nr, 
$ = (F — LHD$ + Gu + Ly, (6.127) 


which is the configuration of Fig. 6.44(a). In this form, if the true control is 
subject to saturation, the same control limits can be applied in Eq. (6.127) to the 
control entering the equation in X, and the nonlinearity does not influence the X 
equation. This is essential for proper estimator performance and can be used as an 
anti-integrator-windup technique important in practical problems. We will return 
to the selection of N, the gain factor of the reference input, after discussing the 
alternative methods of selecting M. 


Case 2 The second approach suggested above is that the tracking error be 
used. This solution is sometimes forced on the control designer because the sen- 
sor only measures the output error. As an example, many thermostats have output 
that is the difference between the temperature to be controlled and the setpoint 
temperature; that is, there is no absolute indication of the reference tempera- 
ture available to the controller. Also, some radar tracking systems have a read- 
ing that is proportional to the pointing error, and this error signal alone must 
be used for feedback control. In these situations, we must select M and N so 
that Eq. (6.125) is driven by the error only. This requirement is satisfied if we 
select 


N = 0, M = -L. (6.128) 
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Then the estimator equation is 
Å = (F- GK - LH) + L(y - r). (6.129) 


The compensator for this case, for low-order cases, is a lead network in the forward 
path. The design can have a considerable amount of overshoot because of the zero 
of the network. However, this goes along with what we found in Chapter 2: The 
addition of a zero tends to increase the overshoot. This design corresponds exactly 
to the compensators designed by transform methods. 


Case 3 The third method of selecting M and N provides the designer with 
maximum flexibility in satisfying transient-response constraints. This will be ac- 
complished if M and N can be selected to add arbitrary zeros of transmission from 
r to y. First we will discuss briefly the relation between the state-variable system 
matrices and the zeros of the corresponding closed-loop transfer function. Consider 
the case where the system uses state feedback and no estimator is involved. Suppose 
we also wish to include a reference input in the control law as u = —Kx+ Nr. 
The equations for the closed-loop system are 


Fx + G(- Kx + Nr), 
Hx, (6.130) 


X 


y 


which may be written as 


x = (F - GK)x + GNr, 


y = Hx. (6.131) 
The system has a zero at s if the equation 
sl-FtGR -G|i X(s)| _ 
H 0 | mal 0 (6.132) 


has a nontrivial solution. This is true if the square matrix on the left loses rank at 
s, that is, if 


det 


sI- F + GK W|-o 


H 0 (6.133) 


The value of this determinant is unchanged if we multiply the last column by K 
and add it to the rest: 


det 


sI — F | =o. 


H 0 (6.134) 


But now the matrix is independent of the feedback gains K. We have proved the 
important result that the zeros of the system are not changed by linear state-variable 
feedback. Equation (6.134) yields the (open-loop) zeros of the plant, which remain 
invariant under state feedback. 
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Consider the controller of Eq. (6.123). If there is a zero of transmission from 
r to u, there is necessarily a zero of transmission from r to y unless there is a 
coinciding point of infinite transmission—which is to say there is a pole at the 
location of the zero. It is therefore sufficient to treat the controller alone. The 
equations for a zero from r to u (we let y = 0 since we only care about the effect 
of r) from Eq. (6.124) is given by 


sI — F + GK + LH We 


det -K N 


(6.135) 


If we divide the last column by the (nonzero) scalar N and add K times the last 
column to the rest, we find the feed-forward zeros are at the values of s such 
that . 


~ -Mg M 
det| 17 F * GK * LH - WK y E. 
0 l 
det[ sI — F + GK + LH - ¥K] = y(s) = 0. (6.136) 


Equation (6.136) is now in exactly the form of the equation we found in the 
estimator design for the selection of L to yield desired locations for the estimator 
poles. Here we have to select M/N for a desired zero polynomial, y(s), in the 
transfer function from the reference input to the control. Thus, there is a substantial 
amount of freedom to influence the transient response by selection of M. We can 
add an arbitrary nth-order polynomial to the transfer function from r to u and 
hence from r to y; that is, we can assign n zeros in addition to all the poles that 
we assigned previously. If the roots of y(s) are not canceled by the poles of the 
system, they will be included in zeros of transmission from r to y. 

There are two considerations that can guide us in the choice of M/N, that is, in 
the location of the zeros. The first is dynamic response. We have seen in Chapter 
2 that the zeros influence the step response significantly. The second consideration 
is steady-state error control. The relationship between steady-state accuracy and 
closed-loop poles and zeros was derived in Chapter 3. If the system is type I, 
the steady-state error to a step input is zero and the error to a unit ramp input is 


tg = — (6.137) 


where K, is the velocity constant coefficient. Furthermore, it was shown in Chapter 
3 that if the closed-loop poles are at (— p;) and the closed-loop zeros are at {—z;}, 
then (for a type I system) 


l l l 
E Fo E: (6.138) 


Equation (6.138) forms the basis for a partial selection of y(s), and hence M and 
N. The choice is based on two observations: 
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1. If p; — zi < 1, then the effect of this pole-zero pair on the dynamic response 
will be small, since the pole is almost canceled by the zero, and, in any transient, 
the residue of the pole at p; will be very small. 


2. Even though p; — z; is small, it is possible for (1/p;) — (1/z;) to be substantial 
and thus have a significant influence on K, according to Eq. (6.138). 


Application of these two guidelines to the selection of y(s), and hence of M and 
N, results in a lag network design. We will illustrate this by an example at the end 
of this section. 

It is now interesting to go back and examine the implication of the first two 
rules in terms of zeros. Under the first rule, we let M — GN. Substituting this in 
Eq. (6.136) yields for the controller feed-forward zeros 


det[sI — F + LH] = 0. (6.139) 


But this is exactly the equation from which L was selected to make the characteristic 
polynomial of the estimator equation equal to a,(s). This means that we have 
created zeros in exactly the same locations as the poles of the estimator. Therefore 
we have placed n zeros right on top of the n poles of the estimator (this pole-zero 
cancellation causes "uncontrollability" of the estimator modes), and the overall 
transfer function poles consist of the state feedback controller poles above. The 
second rule selects M = —L and N = O. If these are substituted in Eq. (6.135), 
we have that the feed-forward zeros are given by 


det (6.140) 


sI-F+GK+LH L|. , 
-K :3 lo 


If we postmultiply the last column by H and subtract it from the rest, and premul- 
tiply the last row by G and add it to the rest, we find that 


CI E L| - 
der -K A =0. (6.141) 


If we postmultiply the first set of columns by (sI — F)~'L and subtract it from the 
last column, we obtain 


det Es ere = 0 (6.142) 
which is 
det(sI — F) det|K(sI — F) !L| = 0, 
Kadj(sI — F)L = 0, (6.143) 


where adj denotes the matrix adjugate. Thus the added zeros are those obtained by 
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replacing the input matrix by L and the output by K. This means that if we wish 
to use error control, we have to accept the presence of these additional zeros. For 
low-order cases this results, as we said before, in a lead network compensator in 
a unity feedback topology. 

Let us now summarize our findings with respect to the introduction of the 
reference input. When the reference input signal is included in the controller, the 
overall transfer function of the closed-loop system is 


Y(s) | K*y(s)b(s) 


HG) = R(s) — @e(s)ae(s)’ 


(6.144) 


where K" is the total system gain and y(s) and b(s) are monic polynomials. The 
polynomial a'.(s) is selected by the designer and results in a control gain K such 
that det[sI — F + GK] = a,(s). The polynomial a, (s) is selected by the designer 
and results in estimator gains L such that det[sI- F + LH] = o.,(s). Therefore, the 
designer has complete freedom in assigning the poles of the closed-loop system. 
The polynomial y(s) can be selected by the designer so that y(s) = @,(s), from 
which M/N is given by Eq. (6.126); or else y(s) may be accepted as given by 
Eq. (6.141), so that error control is used; or finally y(s) may be given arbitrary 
coefficients by selection of M/N from Eq. (6.136). It is important to point out that 
the plant zeros represented by b(s) are not moved by this technique and remain as 
part of the closed-loop transfer function unless a, is selected to cancel some of 
these zeros. 

We now turn to the selection of the gain N in the case where we select method 
| or 3 for M (recall N = O for case 2, error control). For these cases, the zeros 
of the polynomial y(s) are a function of the ratio M/N = M. How should we 
select N? One selection that seems reasonable is to pick N such that the overall 
closed-loop DC gain is unity.* The overall system equations are 


x| |F-GK GK £i G N 
x} | 0  F-LH|i&| |G-M| " 
X 
y=[H 0] "IE (6.145) 
The closed-loop system has unity DC gain if 
-1 
F — GK GK G . 
[H 01 0 En Peery =], (6.146) 


* A reasonable alternative is to select N such that, when r and y are both unchanging, the DC gain from 
r to u is the negative of the DC gain from y to u. The consequences of this choice are that our controller 
can be structured as error control plus generalized derivative control, and if the system is capable of 
type I behavior, that capability will be realized and the two choices are the same (see Problem 6.40). 
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EXAMPLE 6.17 


If we solve for N,* 


l 


N = —— (6.147) 
H(F — GK)~'G[1 — K(F - LH) !(G — M)] 


where M is the outcome of selection of zero locations via either Eq. (6.136) or 
(6.126). The techniques in this section can be readily extended to reduced-order 
estimators. 


The generic servomechanism modeled for small deviations from an operating point 
and scaled for time and amplitude is described by the transfer function 


G(s) = 


s(s + 1) 
or state equations 
xi = X2, 
X2 = —x2- ü. 


Suppose that dynamic response requirements are met by a closed-loop characteristic 
equation 


a-(s) = (s +2} -4 = s? = 4s +8, 
and steady-state error requirements are met by K, — 10. The state feedback gain 
K = [8 3] 


results in the desired poles. However, as the reader may verify, this design has 
K, = 2, and this value is not changed by estimator design if the reference input 
is applied according to choice 1 (the autonomous estimator). If the lead network 
option (that is, error control) is used, a zero is introduced at a location unknown 
beforehand, and the effect on K, is not under direct design control. However, if 
we use the third option, we can satisfy both dynamic response and steady-state 
requirements. First we must select the estimator pole —p3 and the zero z3 so that 
Eq. (6.138) is satisfied. To keep p3 — z3 small and yet have 1/p3 — 1/z3 be large, 
we arbitrarily set p3 small compared with the control dynamics. For example, 
we let 


=p3 = - D. 


* We have used the fact that 


o 6.8 
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Notice that this is the opposite of the usual philosophy on estimation design, where 
fast response is the requirement. Using Eq. (6.138), 


1 jl 1 1 1 
= + — $+ — 
K, pi P2 P3 Z3 


where —p; = —2 + j2, — p; = —2 — j2, and —p3 = —0.1. We want to solve 
for z3 so that K, = 10: 


1 4 1 l 1 
— = — +4 — — — = — 
y 8 01 23 10 
or 
— ——1Ó 
€ 71384. 


We thus design a reduced-order estimator to have a pole at —0.1 and choose M/N 
such that y(s) has a zero at —0.09615. A block diagram of the resulting system is 
shown in Fig. 6.45. The reader can readily verify that this system has the overall 
transfer function 


_ ¥(s) — 8.3(s + 0.09) 
— R(s)  (s?44s + 8Y(s + 0.1)' 


H(s) (6.148) 
which has K, = 10, as prescribed. The compensation shown in Fig. 6.45(a) is 
nonclassical in the sense that it has two inputs (e and y) and one output. If we 
resolve the equations to provide pure error compensation by finding the transfer 
function from e and u, which would give the overall system Eq. (6.148), we 
obtain the system shown in Fig. 6.45(b). This compensation is a classical lag-lead 
network. The root locus of the system of Fig. 6.45(b) is shown in Fig. 6.46, which 
shows the pole-zero pattern near the origin characteristic of the lag network. The 
Bode plot in Fig. 6.47 shows the phase lag at low frequencies and phase lead at 
high frequencies. The step response of the system is shown in Fig. 6.48. i 


Polynomial Solution 


An alternative to the state-space methods discussed so far is to postulate a general- 
structure dynamic controller with two inputs (r and y) and one output (u) and to 
solve for the transfer function of the controller to give a specified overall r-to-y 
transfer function. The situation is as shown in Fig. 6.49. We model the plant as a 
transfer function 


YG) _ b) 
U(s)  a(s) 


(6.149) 
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FIGURE 6.45 
Servomechanism with 
assigned zeros: 

a lag network. 


(s+1)(8.32s+0.8) 
(s+4.08)(s+0.0196) 


(b) 


rather than by state equations. The controller is modeled similarly as 


Cy) y (5) i C, (s) 


beer ro. dts) 


R(s), (6.150) 


where d(s), c,(s), and c,(s) are polynomials. To complete the design, we require 
that the closed-loop transfer function be given by 
Y(s) | c.(s)b(s) 
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FIGURE 6.46 
Root locus of lag-lead 
compensation. 


Im(s) 


< 3 Re(s) 
From Eqs. (6.149) and (6.150), we have that 
e = Cy(s) c,(s) 
a(s)Y(s) = b(s) dió Y(s) + ETF 09 > (6.152) 


which can be rewritten as 
[a(s)d (s) + b(s)cy(s)]Y¥(s) = b(s)c,Cs)R(s). (6.153) 


Comparing Eq. (6.151) with Eq. (6.153), we immediately see that the design can 
be accomplished if we can solve the equation (commonly called the Diophantine 
equation) 


a(s)d(s) + b(s)cy(s) = a¢(s)ae(s) (6.154) 


for given arbitrary a, b, œc, and œe. If a(s) is of degree n and b(s) is of degree n 
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FIGURE 6.47 
Frequency response of 


lag-lead compensation: 


(a) magnitude and 
(b) phase. 
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FIGURE 6.48 
Step response. 


EXAMPLE 6.18 
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| 


1.0 LR——— ina 


oF — —— — 


0.6|— Pe PS ROS 


6A fonse: jm 
j 
0.0 

0 


or less, then a solution for d(s) of degree n and c,(s) of degree n — 1 exists for 
arbitrary a.a, of degree 2n, if and only if a(s) and b(s) have no common factors. 

Notice that c, (s) does not enter in this analysis. However, one can select c,(s) 
to assign zeros in the transfer function from R(s) to Y (s). One choice is to select 
c, (s) to cancel a,(s) so that the overall transfer function is 


I 
c —— 
A 
or 


Time, s 


_ ¥(s) _ K'b(s) 
uada eS T7 


This topic was treated in the state-space setting in the previous section. 


Again, consider the third-order example, Example 6.16. For the case of a full-order 
estimator, we asked for 


a.(s)a,(s) = sÉ + 14s? + 122.75s^ + 585.25? + 1505.64s? 
+ 2476.85 + 1728. 
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FIGURE 6.49 
Direct transfer function 
formulation. 


Dynamic controller 


Using Eq. (6.154) with b(s) = 1 then, 


(dos? + dis? + das + d3)\(s? + 10s? + 16s) 
+ (cos? T Cis + C2) = a-(s)a.(s). 


Equating coefficients of powers of s in the above equation, we immediately see 
that do = | and the coefficients satisfy* 


1 0.0 9.0.0 OT de l 
10 1 0 0 0 0 Ojj di 14 
16 10 1 0 0 0 O|} d2 122.79 
0 16 10 1 0 0 Of} d3} =| 5852 
0 0 16 10 1 O Of} co 1505.64 
0 0 016 0 1 Offe 2476.8 
0 0 0 0 0 0 Le 1728 


The solution is 


do = 1; dı = 4; dy = 66.75; d4 = —146.3; 
co = 1901; C] 4818; C2 1728. 


Hence, the controller transfer function is 


cy(s) | 190.1s? + 481.8s + 172.8 
d(s) s? + As? + 66.75s — 146.3’ 


D(s) — 


and these are exactly the coefficients of the controller that was obtained using the 
state-variable techniques. EK 


The reduced-order compensator can also be derived using a polynomial solu- 
tion. The equations are the same as above, except that both d (s) and c,(s) are of 


*The matrix on the left-hand side is called a Sylvester matrix and is nonsingular if and only if a(s) 
and b(s) have no common factor; see Kailath (1980). 


6.9 
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degree n — 1. Again, working Example 6.16, 
a(s)ae(s) = s? + 11.954 + 74s? + 206s? + 3775 + 288, 
and with b(s) = 1 we should solve 
(dos? dis + d)(s? + 10s + 16s) + (cos? + Crs + Co) = a (s)a. (s). 


Equating coefficients of like powers of s in the above equation, we obtain 


1 0 0 0 0 Of do l 
10 1 0 0 0 Olldi 11.9 
16 10 1 00 0| dz] | 74 
0 16 10 1 0 Ol||co! | 206|' 
0 0 1401 Of] c 377 
0 0 0 00 1Ile 288 


which has the solution 
do =1; d; = 1.9; dı = 39; 
co = —214; cy = —247.2; c? = 288. 
The resulting controller is 


Cy(s) _ —21.4s? — 24.725 + 28.8 
d(s) s? + 1.95 + 39 ; 


which again is exactly the same as that derived using the state-variable techniques. 


D(s) = 


Integral Control 


In the state-space design method discussed up to now, no mention has been made of 
integral control, and no design examples have produced a compensation containing 
an integral term. In fact, state-space design naturally produces a generalization 
of proportional and derivative feedback, as has been pointed out by the design 
examples, but it does not produce integral control unless special steps are taken in 
the design process. 

One way to introduce an integral term is to augment the state vector with the 
desired integral. More specifically, for the system 


x = Fx + Gu, 
y = Hx. 


We can feed back the integral of y as well as the state x by augmenting the plant 
state with the extra state x;, which obeys the differential equation 


X; = Hx( = y). 
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FIGURE 6.50 
Integral control structure. 


EXAMPLE 6.19 


Thus 


«| = | var. 


The augmented state equations become 


and the feedback law is 


or simply 


With this revised definition of the system, the design techniques from Section 6.3 
can be applied in a similar fashion; they will result in the control structure shown 
in Fig. 6.50. 


Suppose the system is given by 


ris) l ; 
= ’ that is, F=-3,G=1H s4, 
U(s) s+3 — 
and we wish to have integral control with closed-loop roots at o, = Sand¢ = 0.5, 


which is equivalent to asking for a desired characteristic equation: 


a-(s) = s? + 5s +25 = 0. 
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FIGURE 6.51 
Integral control example. 


x] 0. 1 x, 0 
4] lo -3]|| x p 
Therefore, we can find K from 
det a-lo l| K = s? 4 5s +25, 
Or 
s? - (3 Ko)s + Kı = s? + 5s +25. 
Therefore 


K-[K; Ko] =[25 2]. 


The system is shown with feedbacks in Fig. 6.51 along with a disturbing input 
w. Notice that if a reference command signal r(t) is introduced, it is the system 
error e — r — y, that must be integrated and not the output alone. This system 
will behave according to the desired closed-loop roots (w, = 5, ¢ = 0.5) and will 
exhibit the characteristics of integral control: Zero steady-state error to a step r and 
zero steady-state error to a constant disturbance w. ag 


O 6.9.1 Internal Model Control 


In the previous section, integral control was introduced in a direct way and the 
structure of the implementation was selected to achieve integral action with respect 
to reference and disturbance inputs. We now present a more analytical approach 
to giving a control system the ability to track (with zero error) a nondecaying in- 
put and to reject (with zero error) a nondecaying disturbance such as a step, a ramp, 
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or a sinusoid. The method is based on including the equations satisfied by these 
external signals as part of the problem formulation and solving the problem of 
control in an error space so that we are assured that the error approaches zero even 
if the output is following a nondecaying, or even a growing, command (such as a 
ramp signal). The method is illustrated in detail for signals of order 2. 

Suppose we have the state equations 


& = Fx + Gu + Giw, 
y = Hx Ju, (6.155) 


and we wish to do a pole-placement design and at the same time design a controller 
so the closed-loop system can track a second-order input with zero steady-state error 
and reject second-order disturbances without error. We can define the reference input 
as satisfying the differential equation 


P = aj,r t ar. (6.156) 
In a similar fashion, we take the disturbance to satisfy 
W = aw t a»w. (6.157) 
The (tracking) error is defined as 
e=y-r. (6.158) 


The problem of tracking r and rejecting w can be seen as an exercise in designing 
a control law to provide regulation of the error, which is to say such that the error 
e tends to zero as time gets large. The control must also be structurally stable or 
robust, in the sense that regulation of e to zero in the steady-state occurs in the 
presence of perturbation of system parameters. Note that in practice one never has 
a perfect model and that the values of parameters are virtually always subject to 
change. 

One way to formulate the tracking problem is to differentiate the error equation 
and introduce the error as a state. Thus, we have from Eq. (6.158) the formula 


e8-2y-r 
= Hi + Jü —ayr — aor. (6.159) 


To obtain the overall state vector, the plant-state vector is replaced by the state in 
error space defined by 


€ Ê & ajk — ox, (6.160) 
and the control vector is replaced by the control vector in error space 
u Ê ü -aù — æu. (6.161) 
The error-state formula, from Eq. (6.159), is 
é —a,e —a5e = Hé - Jp. (6.162) 


EXAMPLE 6.20 
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The state equation for £ is given by* 
¿ = į- aX = 2X 
= Fé + Gy. (6.163) 


Equations (6.160) and (6.161) now describe the overall system state; in state- 
variable form, these are 


"Ter CEN M (6.164) 
where z — [e é . E] and 
0. 1.2 0 
A=/|a@ o, H B-|J|. (6.165) 
0 0 FE G 


The error system (A, B) can be given arbitrary dynamics by state feedback if it 
is controllable. If the plant (F, G) is controllable and does not have a zero at the 
roots of 


a,(s) = s^ — as — ao, 


the error system (A, B) is controllable. Therefore there exists a control law of the 
form 


Hb = —[K» K, Ko | e| = — Kz, (6.166) 


so that the error system has arbitrary dynamics by pole placement. We now need 
to express this control law in terms of the actual process state x and the actual 
control. In terms of u and x we have the control law, 


2 2 
(u + Kox)? = > aru + Kox)? ? — >) Kel”. 


i=] i=l 


Consider a servomechanism to follow the data track on a computer-disk memory 
system. Because the data track is not exactly a centered circle, the radial servo 
must follow a (“runout”) sinusoid input of radian frequency wọ. The (normalized) 
parameters are 


F 


l s-: H=[1 0]; 


* Notice that this concept can be extended to more complex equations in r and to multivariable systems. 
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FIGURE 6.52 


Structure of the compensator for the servomechanism to track exactly the sinusoid of frequency o o. 


and the reference input satisfies ? = —wr. The error state matrices are 
0 10 0 0 
2 
ai 0 00 1?’ aS 0 
0 00 ~i l 


The characteristic equation of A — BK is 
$^ + (1 + Ko)s? + (w3 + Koi)s? + [Ki + 3(1 + Koz)]s + K2 + Koi? = 0, 


from which the gain may be selected if pole assignment is satisfactory for the design 
(see Problem 6.44). The compensator implementation has the structure shown in 
Fig. 6.52, which clearly shows the presence of the oscillator with frequency «o 
(known as the internal model of the input generator) in the controller.* 

Let's now consider the case of tracking constant inputs, that is, 7 = 0. In 
terms of u and x, we have the control law 


u = —Ky\e — Kox. (6.167) 


Here we only need to integrate to reveal the control law and the action of integral 
control, 


t 
= -x Í edt — Kox. (6.168) 


*This is a special case of the internal-model principle, which requires a model of the exogenous signal 
in the controller for robust tracking and disturbance rejection. See Francis and Wonham (1976). 


EXAMPLE 6.21 
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A block diagram of the system is seen in Fig. 6.50; it clearly shows the presence 
of a pure integrator in the controller. E. 


From the nature of the pole-placement problem, the state z in Eq. (6.164) will 
tend to zero for all perturbations in the system parameters so long as A — BK 
remains stable. The nature of the design is such that it creates structurally robust 
"blocking" zeros (that is, those which do not change as the parameters change) 
from r and w to e, thereby completely blocking transmission of signals at roots of 
a, (s) between the external signals and the system output error e. 


Let's repeat the example of the previous section: 


with state-variable description 


The error system is 


Z Z 
If the desired characteristic equation is taken to be 
als) = s" + 5s + 25, 

the pole-placement equation for K is 

det[sI — A + BK] = o.(s). 
In detail, it is 

s? (3 + Ky)s + Ko = s? 5s +25, 

which gives 

K = [25 2] = [Ko: Ki], 
and the system is implemented as shown in Fig. 6.51. If we compute the transfer 
function from r to e, 
E(s) 7 —s(s + 5) 
R(s) s? + 5s +25’ 


which clearly shows the “blocking” zero at s = 0. The overall transfer function is 


r(s) _ 29 


Hb e ERE m A 
us gy) Se Se 325 
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FIGURE 6.53 


Robust servomechanism with zero assignment. 


FIGURE 6.54 
Robust servomechanism. 


Process 


The structure of Fig. 6.50 permits the engineer to add the feed-forward of the 
reference input, which provides additional freedom in zero assignment. If we add 
a term proportional to r in Eq. (6.168), then 


t 
“= -x Í e(r) dT — Kox + Nr, 
and this has the effect of creating a zero at — K/N . The location of this zero can be 
chosen to improve the transient response of the system. For actual implementation, 
the above equation can be rewritten in terms of e: 


t 
u = -x Í e(t)dt — Kox + N(y — e). (6.169) 


The system is as shown in Fig 6.53. For our example, the overall transfer function 


FIGURE 6.55 
Step responses. 
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now becomes 


_ FG) Ns+2 
R(s)  s245s-425' 


and its implementation is shown in Fig. 6.54. Notice that the DC gain is unity for 
any value of N and that by choice of N we can place the zero anywhere we like 
to improve the dynamic response. The step response of the system is as shown 
in Fig. 6.55 for two values of N. In computer-aided design Emami-Naeini and 
Franklin (1982) show how to optimize the choice of N with respect to a performance 
criterion. d 


10 
=() Time, s 
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o 6.10 


Design for Systems with Pure Time Delay 


In any linear system consisting of lumped elements, the response of the system 
appears immediately after an excitation of the system. In some instances in feedback 
systems—for example, in process control, whether in systems controlled by a 
human operator in the loop or in computer-controlled systems—there is a pure 
time delay or transportation lag in the system [see Fig. 6.56(a)]. As a result of 
the distributed nature of these systems, the response remains identically zero until 
after some time period A. The transfer function of a pure transportation lag is 
e ^, We can represent an overall transfer function of a (SISO) system with time 
delay as 


G;(s) = G(s)e ^5, (6.170) 


where G(s) has no pure time delay. Since G;(s) does not have a finite state de- 
scription, standard use of state-variable methods is impossible. However, O. J. M. 
Smith (1958) showed how to construct a feedback structure that effectively takes 
the delay outside the loop and allows a feedback design based on G(s) alone, 
which does have a state description. The result is a closed-loop transfer function 
with delay A and otherwise the response of a closed-loop design based on no 
delay. Consider the feedback structure shown in Fig. 6.56(b). The transfer func- 
tion is 
Y(s) . D(sye ^G(s) 


R(s) = 4 + D(sy)e-5G(s) (6.171) 


Let us postulate a modified compensator, D(s), such that the transfer function is 


Y(s) | D(s)G(s  .y 


——— c 6.172 
Rs) 1-G(sSD(G). nid 

If we equate Eqs. (6.171) and (6.172), we will find 
D(s) = ali (6.173) 


1+ D(s)'[-G(s) + Gaje] 


and the compensator is as shown in Fig. 6.56(c). So with this structure we can 
design the compensator D(s) in the usual way, as if there were no delay, and then 
implement it as shown in Fig. 6.56(c). The resulting closed-loop system would 
exhibit the behavior of a finite state closed-loop system except for a time de- 
lay of A. Conceptually, the Smith compensator is feeding back the output of the 
plant without the delay, that is, the output of G(s), and with e ^* appearing as 
the second block in series with G(s). The reader may verify this using block di- 
agram manipulation. It can be demonstrated that the compensator, shown by the 


FIGURE 6.56 
A Smith regulator for 
systems with time delay. 
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(a) 


(c) 


dashed lines in Fig. 6.56(c), is equivalent to an ordinary regulator in cascade with a 
compensator that provides significant phase lead (see Åström, 1977). It would be 
difficult to implement such compensators in analog systems; however, they can 
be implemented satisfactorily using digital compensators (see Chapter 8) and are 
currently being used by process-control industries. 
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EXAMPLE 6.22 Consider the heat exchanges shown in Fig. 6.57. A linear model for the system 
can be represented by 


es 
GG) = q0s 4 0st 


A suitable set of state-space equations is 


wa, _ | 70.017 0.017 0 " 
x(t) = | 0 —0.1 | x(t) + P: ult — 23), 
y=[1 0]x, 


A= 5. 
Suppose we wish to place the closed-loop poles at 
a.(s) = s t 0.05 + j0.087; 
then the state feedback gain is (ignoring the delay) 
K = [5.2 —0.17]. 
If we pick the estimator poles three times faster, 


a(s) = s-FO.15 +. 70,26, 


FIGURE 6.57 
A heat exchanger. 
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then the estimator gain matrix for a full-order estimator is 


TX eal 


4.2 


If we choose to cancel the estimator poles with the feed-forward zeros and want 
unity DC gain, then 


N = 6.0 and M = GN. 
The controller transfer function resulting from all this is 


U(s) —.25(s + 1.8) 
D(s) = V = —— 
Y(s) s+ 0.14 £ j0.27 
The open-loop and closed-loop step responses of the system and the control effort 
are shown in Figs. 6.58 and 6.59, and the root locus of the system (without the 
delay) is shown in Fig. 6.60. Note that the time delay in Figs. 6.58 and 6.60 is 
quite small compared with the response of the system, and is barely noticeable in 
this case. A 


Lyapunov Stability 


It should be obvious by now that stability plays a major role in control-system 
design. We have already considered bounded-input-bounded-output stability based 
on impulse response, Routh’s criterion based on the coefficients of the characteristic 
equation, and Nyquist’s criterion based on the frequency response. In this section, 
we consider a very important technique for the analysis (and design) of nonlinear 
dynamic systems based on the state-variable form of ordinary differential equations. 

A. M. Lyapunov* considered stability of general systems described by ordinary 
differential equations in state-variable form. To illustrate a few points of his very 
useful theory, we consider first the general set of state equations, 


x = f(x). (6.174) 


If the function f(x) = Fx, then we have the linear case considered throughout 
this chapter. We assume that the equations have been written so that x = O is an 


* A. M. Lyapunov studied dynamic systems in Russia, and his fundamental work, On the General 
Problem of Stability of Motion, was published in 1892 by the Kharkov Mathematical Society. 
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FIGURE 6.58 
Step responses for a heat exchanger. 
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equilibrium point, which is to say that f(0) = 0. This equilibrium point is said 
to be stable in the sense of Lyapunov if we are able to select a nonzero initial 
condition that will result in a trajectory that remains small. The equilibrium is said 
to be asymptotically stable if it is Lyapunov-stable, and furthermore the state goes 
to zero as time goes to infinity. More formally, the system described by Eq. (6.174) 
has a stable equilibrium at x = 0 if, for every e there is a ô such that if ||x(0)|| < 6 
then ||x(r)|| < e for all t.* Pictures of stable and unstable responses are sketched in 
Fig. 6.61. 


*Ix|? = x7x = »77., x? is a measure of the length of the vector x. 


i 
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FIGURE 6.59 
Control effort for a heat exchanger. 
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For constant linear systems, we see at once that x = Fx is stable if none 
of the characteristic roots of F are in the right-half plane and if any roots on the 
imaginary axis are simple. (A multiple root on the imaginary axis would have a 
response that grows in time and could not be stable.) Furthermore, the response 
of a linear constant system is asymptotically stable if all the characteristic values 
of F are inside the left-half plane. Comparing with the results on BIBO stability 
(see Section 3.5.1), we see that linear constant systems that are BIBO-stable are 
asymptotically stable in the sense of Lyapunov, and, furthermore, we can have 
stable systems in the sense of Lyapunov that are not BIBO-stable. (The capacitor 
is a case of this.) 

Lyapunov showed that if one has a nonlinear system, such as in Eq. (6.174), 
and it is expanded into the form 


x = Fx + g(x), (6.175) 
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FIGURE 6.60 


Root locus for a heat ex- 


changer. 


FIGURE 6.61 
Definition of stability in 
the sense of Lyapunov. 
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where g(x) contains all the higher powers of x to the extent that 


.. leol _ 


lxi |x| 


(that is, g(X) goes to zero faster than x does), then the system will be stable if all 
the roots of F are strictly inside the left-half plane and will be unstable if at least 
one root is in the right-half plane. For systems with roots in the left-half plane 
and on the imaginary axis, the stability depends on the terms in the function g. 
In order to improve these results, Lyapunov introduced a function that has many 
of the properties of energy. He then proved that if the "energy" is always getting 


Unstable 
trajectory. 
Stable 
trajectory 


(a) (b) 
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smaller, it must finally run out and the system come to rest. The argument goes 
like this: For a state x, consider a scalar function V(x) having the property that 


1. V(O) = 0; 

2. V(x) > 0, ixi £ 0; 

3. V is continuous and has continuous derivatives with respect to all components 
of x; 

4. V(x) <0 along trajectories of the equation. 


Properties | and 2 mean that V, like energy, is positive if any state is different 
from zero but equals zero when the state is zero. Property 3 ensures that V is 
a smooth function and generally has the shape of a bowl near the equilibrium. 
Property 4 guarantees that the trajectory moves so as to never climb higher on 
the bowl than it starts out. If property 4 is made stronger so that V < O for 
\|x|| Æ 0, then the trajectory must be drawn to the origin. The stability theorem is: 
Given the system of equations X — f(x), if there exists a Lyapunov function for 
this equation, the origin is a stable equilibrium point. If, in addition, V < 0, the 
stability is asymptotic. 

For the linear constant systems of main concern here, the quadratic function is 
adequate. Consider the function V = xTPx, where P is a symmetric positive matrix. 
For example, if P — I, then V is the sum of squares of the components of x as 
V = »7., x?. In general, if P is positive, it means that we can find a matrix T 
such that P = TTT and V = »77.,z?, where z = Tx. For such a P the quadratic 
function satisfies conditions 1, 2, and 3 of a Lyapunov function. A well-known test 
for a symmetric matrix to be positive is that the determinants of the n principal 
minors of the matrix are positive. We need to consider condition 4, the derivative 


condition. To compute the derivative of V, we use the chain rule as follows: 
V = —x'Px 


= x! Px + x! Px 
= x'(F'P + PF)x 
= -x'Qx, 
where 
F'P + PF = -Q. (6.176) 


Lyapunov showed that, for any positive Q, the solution P of the Lyapunov equation 
(Eq. 6.176) is positive if and only if all the characteristic roots of F have negative 
real parts. In other words, if we are given the system matrix F, we can select a 
positive Q such as I, solve the Lyapunov equation (which is just a system of linear 
equations in n(n — 1)/2 unknowns) and test to see if P is positive by looking at 
the determinants of the n principal minors. From this we can determine the stability 
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EXAMPLE 6.23 


FIGURE 6.62 

A model of an 
elementary position 
feedback system with 
a nonlinear actuator. 


of the equations without either solving them or finding the characteristic roots, a 
much harder problem. An example may help illustrate this theory. 


Consider 
-|< B 
F Ho ag a0 
Let Q = I. The Lyapunov equation is 
=x =P] p-a p q|| -a Bp -[ 0 
B -ljg f g fT||-B. ~a 0 =] 


Multiplying out and equating coefficients, 
—ap — Pq -ap - Bq = -l 
-aq — Pr + Pp -aq = 
Bq =ar t Bg —ar = —1. 
These equations are readily solved by p = r = 1/2a, q = O so that 


| 
= 


1/2a 0 


P=] o Ma 


and the determinants are 1/2œ > 0 and 1/4a? > 0. 
Thus P is positive, and we conclude that the system is stable if a > 0. E 


For systems with more state variables, solution of the Lyapunov equation 
(Eq. 6.176) can be burdensome, but the result is an alternative to computing the 
characteristic values. 

Testing for stability by considering the linear part is referred to as Lyapunov’s 
first, or indirect, method; using the idea of the Lyapunov function directly on 
the nonlinear equations themselves is called the second, or direct method. As an 
example of the direct method, consider the position feedback system modeled in 
Fig. 6.62. 

We assume that the actuator, which is perhaps only an amplifier in this case, 
has a significant nonlinearity sketched as a saturation but possibly more complex. 


Summary 457 


Here we will assume only that u = f(e), where the function lies in the first and 
third quadrants so that p f(e)de > 0. We also assume that T > 0, so that the 
system is open-loop stable. The equations of motion are 


e E = KI 
X2 = — xX + —. (6.177) 


For a Lyapunov function, consider something like kinetic plus potential energy: 


= -— + | fede. 
2 0 


Clearly V = 0 if x? = e = O and, because of the assumptions on f, V > 0 if 
x3 + e? # 0. To check to see if this is a Lyapunov function, we compute V as 
follows: 


V = Tx2ž2 + flee 


1 
-772+ zm + f(eXx—x2) 


T x» 


= x 

Hence, V < 0 and the origin is stable. In fact, V is always decreasing if x2 £ 0, 
and, from Eq. (6.177), the system has no trajectory with x2 = 0, except x2 = 
e = 0; so in fact we can conclude that the system is asymptotically stable for 
every f that satisfies | f da > 0. 

As we mentioned, the study of the stability of nonlinear systems is vast, and 
we have only touched on some important points and methods. Further material for 
study can be found in LaSalle and Lefschetz (1961), Kalman and Bertram (1960), 
and Vidyasagar (1978). 


Summary 


In this chapter, we have considered systems described by state variables. Anal- 
ysis techniques and design methods to obtain compensation for stabilization and 
improved dynamic behavior have been presented. We have seen that, if a system 
is controllable, a unique control gain K can be found such that the closed-loop 
characteristic polynomial a,(s) of F — GK can be given arbitrary poles. (Complex 
poles must appear in conjugate pairs.) The selection of poles via ITAE and Bessel 
responses and by the symmetric root-locus method have been discussed. 

We have seen how an estimator can be designed such that the estimated-error 
characteristic polynomial a,(s) of F — LH can be given arbitrary poles. We have 
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seen how the combination of the controller and estimator can be interpreted to 
yield a classical compensator similar to those designed in Chapters 4 and 5. The 
separation principle allows for independent design of the controller and estimator. 
Duality between the control and estimation problems has been pointed out. 

The idea of tracking a reference input has also been discussed. Introduction 
of the reference signal allows for assigning new zeros, placing zeros on top of 
estimator poles, or using error control. The general idea is that state feedback 
allows for assigning poles, and feed-forward control allows for assigning new 
Zeros. 

We have seen that the same type of compensator can be obtained using poly- 
nomials as using state variables. However, this technique is guided by insight into 
the problem gained using state-variable techniques. The use of integral control in 
robust servomechanisms has been discussed and the Smith regulator for systems 
with pure time delay was presented briefly. Finally, we have touched on the notions 
of stability for nonlinear systems as set forth by Lyapunov. 


Appendix 6A: 
Solution of State Equations 


In this appendix, we consider the solution of state-variable equations. This material 
is not necessary to understand the design method of pole placement but will give 
a deeper insight into the method of state variables. It is instructive to consider first 
the unforced, or homogeneous, system, which has the form 


x = F(t)x, x(0) = Xo. (6A. 1) 
If the elements of F(t) are continuous functions of time, the above equation has a 
unique solution for any initial state vector xo. There is a useful representation for 


the solution of this equation in terms of a matrix, called the transition matrix. Let 
Qi(t, to) be the solution to the special initial condition 


<— ith row. 


x(0) = e; = (6A.2) 


0 
0 
l 
0 
0 
If x(to) is the actual initial condition at tọ, we can express it in the decomposed 
form 


X(fo) = Xoe, + Xozëz + °°* + Xonen. (6A.3) 


Because Eq. (6A.1) is linear, the state x(t) can also be expressed as a sum of the 
solutions to the special initial conditions $;, as follows: 


X(t) = Xoidi(t, to) + Xo2d»o(t, to) + ^^^ + Xon. (t, to), (6A.4) 
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or, in matrix notation, 
X01 
x(r) = Qilt, to), Palt, to), «1 Balt, tol] | (6A.5) 
Xo, 
So we define the transition matrix* to be 
M(t, to) = [hilt, to), (t, to), ..., Pn(t, to)] (6A.6) 
and write the solution as 
x(t) = W(t, to)x(to), (6A.7) 


where, as the name implies, the transition matrix provides the transition between 
the state at time fo to the state time t. Furthermore, from Eq. (6A.7) we have 
that 


d d 
40 = 4; 9t. to)]x(to), (6A.8) 


and from Eq. (6A.1) and (6A.8) we have 


XO = Fx(r) = F@(t, to)x(to). (6A.9) 

Therefore 
PL to)] = F@(t, to) (6A. 10) 

and also 
M(to, to) = I. (6A.11) 


The transition matrix can be shown to have many interesting properties. Among 
them are the following: 


» it, to) = D(t2, t))P(t1, to); 
2. ® \(t, 7 = (o, t); 


3. Lo, » = -aE DFO: 
dT 


4. det dr, to) = elo FOr, (6A.12) 


The second property implies that ®(t, 7) is always invertible. What this means is 
that the solution is always unique so that, given a particular value of state at time 


*This is also referred to as the fundamental matrix of the differential equation. 
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T not only can we compute the future state from ®(t, 7) but also past values from 
$ !(, 7). 
For the homogeneous case, with a forcing function input u(t), the equation is 


x(t) = F(t)x(t) + G(t)u(t), (6A.13) 


and the solution is* 


x(t) = M(t, to)Xo «| P(t, 7)G(r)u(7) dT. (6A.14) 


to 
We can verify this simply by substituting the supposed solution (Eq. 6A.14) into 
the differential equation (Eq. 6A.13): 


d d A 
Lan = Le, o+ È | ie. 7)G()u()] dr. (6A.15) 


The second term from calculus (using the Leibnitz formula) is 


£ i [Ó(r, 7)G(r)u(7)] drt 


-| F(t)®(t, 7)G(r)u(r) dv + P(t, t)G(t)u(t). (6A.16) 


Using the basic relations, we have that 


x(t) = F(t)®(t, to)xo + F(t) | P(t, 7)G()u(7) dt + G(t)u(t) 


to 


= F(t)x(t) + G(t)u(t), (6A.17) 


which shows that the proposed solution satisfies the system equation. 
For the time-invariant case, 


M(t, to) = ef" = P(t — to), (6A. 18) 
where 
243 © xk 
Fr A F*t NE M Ft 
is an invertible n X n exponential matrix, and, by letting t = 0, we see that 
pak (6A.20) 
The state solution is now 
t 
x(r) 2 a" «| eF 7 Gu(r) dv (6A.21) 
to 


*The first term is the natural response due to the initial condition xo, and the second term is the 
superposition integral that applies because the system is linear. 
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and 
t 
y(t) = HeF' (9x, + n| eF" "Gu(r) dr + Ju(t). (6A.22) 
to 


Suppose x(to) = Xo = 0, then the output is given by the convolution integral 


y(t) = | h(t — T)u(7) d 7, (6A.23) 


0 


where A(t) is the impulse response. In terms of the state-variable matrices, 
h(t)  HeF'G + J&(r). (6A.24) 


While there is no uniformly best way to compute the transition matrix, there 
are several methods that can be used to compute approximations to it (see Moler 
and van Loan, 1978, and Franklin, Powell, and Workman, 1990). Three of these 
are matrix exponential series, inverse Laplace transform, and diagonalization of 


the system matrix. In the first technique, we use Eq. (6A.19): 
f£ p 
g” "DEGCEES +E + vee, (6A.25) 


and the series should be completed in a reliable fashion. For the second method, 
we notice that if we define 


$(s) = (sI-F)'!, (6A.26) 


then we can compute ®(s) from the F matrix and matrix algebra. Given this matrix, 
we use the inverse Laplace transform to compute 


$()-2'[bi]-22£2'(sI-F)!] (6A.27) 


The last method we mentioned operates on the system matrix. If the system matrix 
can be diagonalized, that is, if we can find a transformation T so that 


A. = TFT, (6A.28) 
where F is reduced to the similar but diagonal matrix, 
A = diag} Aj, A, ..., Àn} ; (6A.29) 


then from the series (Eq. 6A.19), we see that we need only compute scalar expo- 
nentials, since 


e" = T 'diag { e^", TM eet p (6A.30) 


Appendix 6B: 
Controllability and Observability 


Controllability and observability are important structural properties of a dynamic 
system. These concepts were identified and studied first by Kalman (1960) and later 
by Kalman, Ho, and Narendra (1961). These properties have continued under much 
study during the last three decades. We will discuss only a few of the known results 
for linear constant systems with one input and one output. We have encountered 
these concepts already in connection with control law and estimator designs. We 
suggested in Section 6.3 that if the square matrix given by 


€$ =[G:FG:F’G: -:::F"'G] (6B.1) 


is nonsingular, by transformation of the state we can convert the given description 
into the control canonical form. A control law can then be constructed such that 
the closed-loop system can be given an arbitrary characteristic equation. We begin 
our discussion of controllability by making the statement (the first of three): 


Definition I: The system (F, G) is controllable if for any given nth-order polyno- 
mial a@,(s) there exists a (unique) control law u = —Kx such that the characteristic 
polynomial of (F - GK) is a,(s). 


From the results of Ackermann’s formula (Appendix 6C), we have the mathematical 
test for controllability: (F, G) are a controllable pair if and only if the rank of € is 
n. The above definition based on pole placement is a frequency-domain concept. 
Controllability can be equivalently defined in the time domain. 


Definition II: The system (F, G) is controllable if there exists a (piecewise continu- 
ous) control signal u(t) such that the state of the system can be taken from any ini- 
tial state X to any desired final state x; in a finite time interval. 
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We will now show that the system is controllable by this definition if and only 
if € is full-rank. Assume that the system is controllable but 


rank[G : FG : F°G: -+ : FIG] <n. (6B.2) 
We can then find a vector V such that 
V[G: FG: F"G: -::: F'G] = 0 (6B.3) 
Or 
VG = VFG = VF’G = ::: = VF" 'G = 0. (6B.4) 
The Cayley-Hamilton theorem states that F satisfies its own characteristic equations, 
namely, 
—F" = aF"! + aF"? + +++ + al. (6B.5) 
Therefore 


—VF"G = a, VF" !G + a; VF" ?G 4 --- - a, VG = 0. (6B.6) 


By induction, VF"**G = 0 fork = 0,1,2,..., or VF"G = 0 for m = 
0, 1,2, ..., and thus 


Ve'G = vir +Ft + ;F +:|G=0 (6B.7) 
for all t. However, the zero initial-condition response (xo = 0) is, from 
Appendix 6A, 

x(t) = i e""-DGu(r)dr (6B.8) 
or 
x(t) = e" k e F'Gu(r)dr. (6B.9) 


Using Eq. (6B.7) then, 


t 
Vx(t) = | Ver Gu(r) dt = 0 (6B. 10) 
0 
for all u(t) and t > 0. This implies that all points reachable from the origin are 
orthogonal to V. This restricts the reachable space and therefore contradicts the 
definition of controllability. Thus if € is singular, (F, G) are not controllable by 
definition II. 
Next, assume that is full-rank, but the system is uncontrollable by definition 
II. This means that there exists a nonzero V such that 


t 
v| ef" Gu(r) dt = 0, (6B.11) 
0 


FIGURE 6.63 

Block diagram of a 
system with a diagonal 
F matrix. 
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since the whole state space is not reachable. But Eq. (6B.11) implies that 
Veh MG 20 OS7S ty. (6B. 12) 


If we set 7T = ty, we See that VG = 0. Also, differentiating Eq. (6B.12) and 
letting 7 = tf gives VFG = 0. Continuing this process, we find that 


VG = VFG = VF’G = ::: = VF" 'G = 0, (6B. 13) 


which contradicts the assumption that @ is full-rank. 
We have shown that the system is controllable by definition II if and only if 
the rank of & is n, exactly the same condition we found for pole assignment. 
Our final definition is closest to the structural character of controllability: 


Definition III: The system (F, G) is controllable if every mode of F is connected to 
the control input. 


Because of the generality of modal structure of systems, we will only treat the 
case of systems for which F can be transformed to diagonal form. (The double 
integration plant does not qualify.) Suppose we have a diagonal F4 matrix and 
the corresponding input matrix G4 with elements g;. The structure is as shown 
in Fig. 6.63. By definition, for a controllable system the input must be connected 
to each mode so that the g;’s are all nonzero. However, this is not enough if the 
poles (A;'s) are not distinct. Suppose, for instance, A; = A2. The first two state 
equations are then 


žida = AixXia + giu, 
X2q = Aj X2q + 824. (6B. 14) 
If we define a new state, € = goxiqg — 81X24, the equation for £ is 
E = gid — g1Xoq = g2AiXia + g281u — giluxoa — 81824. = ME, 
(6B.15) 
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which does not include the control u; hence € is not controllable. The point is 
that if any two poles are equal in a diagonal F4 system with only one input, we 
effectively have a hidden mode that is not connected to the control, and the system 
is not controllable. This is because the two state variables move exactly together 
and we cannot control x ;4 and x54 independently. Therefore, even in such a simple 
case, we have two conditions for controllability: 


1. All eigenvalues of F4 are distinct. 
2. No element of Gz is zero. 


Let us consider the controllability matrix of this diagonal system. By direct 
computation, 


£i gà c^ gi! 
«€ =| 82 82À 


£n $nÀn °°’ Bar 


Ap Apc ADU 
81 0 2 è 
= g2 e i (6B.16) 
Ü Fa : 
| A, AX ATO 


The controllability matrix is the product of two matrices, and € is nonsingular 
if and only if both factors are invertible. The first term has a determinant that 
is the product of g;’s, and the second term (called the Vandermonde matrix) is 
nonsingular if and only if the A;'s are distinct. Thus definition III is also equivalent 
to nonsingular €. 

As our final remark on the topic of controllability, we present a mathematical 
test that is an alternative to testing the rank (or determinant) of €. This is the 
Popov-Hautus-Rosenbrock (PHR) test (see Rosenbrock, 1970, and Kailath, 1980). 
The system (F, G) is controllable if the system of equations 


V"[sI -F :G] = 0T (6B.17) 
has only the trivial solution VT = 0T, or, equivalently, 
rank[sI — F : G] = n, (6B.18) 
or if there is nonzero VT such that* 
VIF = sV', 
V'G - 0. (6B.19) 


* VT is a left eigenvector of F. 


FIGURE 6.64 
Examples of an 
uncontrollable system. 
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This test is equivalent to the rank-of-% test. It is easy to show that if such a V 
exists, € is singular, for if a nonzero V exists such that V'G = 0 by Eq. (6B.19a), 
then 


V'IFG = sV'G = 0. (6B.20) 
Multiplying by FG, we find 
V'F’G = sV'FG = 0, (6B.21) 


and so on. Thus, we derive that V'€ = OT has a nontrivial solution, «€ is singular, 
and the system is not controllable. To show that a nontrivial VT exists if € is 
singular requires a bit more work. 

We have given two pictures of uncontrollability. Either a mode is physically 
disconnected from the input, or else two parallel subsystems have identical char- 
acteristic roots. The control engineer should be aware of the existence of a third 
simple situation, illustrated in Fig. 6.64— namely, a pole-zero cancellation. Here 
the problem is that the mode at s = 1 appears to be connected to the input but 
is masked by the zero at s — 1 in the preceding member; the result is an uncon- 
trollable system. This can be confirmed in several ways. First let us look at the 
controllability matrix. The system matrices are 

=] Q m 
"ya ey 


A state variable 
is not connected 
to the input. 


A state variable 
is "masked" 
by a zero. 


Two state variables 
move exactly 
together. 
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and 
€-I[G FG]-| 2 
which is clearly singular. If we compute the transfer function from u to xı, we 
find 
ge) 1 
H(s) = 
(s) ttig =] 
PE 
og +) 


Since the natural mode at s = 1 disappears from the input-output description, it 
is not connected to the input. Finally, if we consider the PHR test, 


s+] 0 m. 
[sI — F : G] = ik paces E 
and let s = 1, we must test the rank of 
2 0 -2 
—] O 1?’ 


which is clearly less than 2, which means, again, the system is uncontrollable. 
In conclusion, we have three definitions for controllability: pole assignment, state 
reachability, and mode coupling to the input. These definitions are equivalent, and 
the tests for any of these properties are found in terms of the rank of the control- 
lability matrix or the rank of the matrix pencil [sI — F : G]. If € is nonsingular, 
we can assign the closed-loop poles arbitrarily by state feedback, we can move the 
state to any point in the state space in a finite time, and every mode is connected 
to the control input. * 

So far, we have discussed only controllability. The concept of observability 
is parallel to that of controllability, and all of the results we have discussed thus 
far may be transformed to statements about observability by invoking duality, as 
discussed in Section 6.5.1. The observability definitions dual to controllability are 


Definition I: The system (F, H) is observable if, for any nth-order polynomial 
a, (s), there exists an estimator gain L such that the characteristic equation of the 
state estimator error is @,(s). 


Definition II: The system (F, H) is observable if, for any x(0), there is a finite time 
7 such that x(0) can be determined (uniquely) from u(7) and y(7). 


Definition III: The system (F, H) is observable if every dynamic mode in F is con- 
nected to the output via H. 


* We have shown the latter for diagonal F only, but the result is true in general. 
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As seen in the discussion for controllability, a mathematical test can be devel- 
oped for observability. The system is observable if the matrix 


H 
HF 
HF" =i] 


is nonsingular. If we take the transpose of © and let H' = G and FT = F, we 
find the controllability matrix of (F, G), another manifestation of duality. 
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Ackermann’s Formula for Pole Placement 


We have the plant and state-variable equation 
x = Fx + Gu (6C.1) 
The objective is to find a state feedback control law 
u — —Kx, (6C.2) 
so that the closed-loop characteristic polynomial is 
a.(s) = det[sI — F + GK]. (6C.3) 


First, we have to select a ,(s), which determines where the poles are to be shifted, 
and then solve for K such that Eq. (6C.3) is satisfied. Our technique is based on 
the transformation of the plant equation to the control canonical form. 

We consider the affect of an arbitrary nonsingular transformation of the state 


X — Tx, (6C.4) 


where X is the new transformed state. The equations of motion in the new coordi- 
nates are, from Eq. (6C.4), 


x = Tx = Fx + Gu 
= FTX + Gu; (66.5) 
x = T FTX + T 'Gu = Fx + Gu. (6C.6) 
The controllability matrix for the original state, 

€, =[G FG FG -- F"'!G] (6C.7) 
provides a useful transformation matrix. We can also define the controllability 

matrix for the transformed state: 
€--[G FG FG — F 


n=] 


G 1. (6C.8) 
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The two controllability matrices are related by 
€, = [T GT FIT 'G--]- T '€, (6C.9) 
and the transformation matrix 
Tou v (6C. 10) 


We can draw some important conclusions from Eqs. (6C.9) and (6C.10). From 
Eq. (6C.9), we see that if €, is nonsingular, then for any nonsingular T, 6+ is 
also nonsingular. This means that a similarity transformation on the state does not 
change the controllability properties of a system. From Eq. (6C.10), we can go 
the other way. Suppose we would like to find a transformation to take (F, G) into 
the control canonical form. As we shall see shortly, 6+ in that case is always 
nonsingular. From Eq. (6C.9), we see that a nonsingular T will always exist if and 
only if €, is nonsingular. We conclude: 


We can always transform (F, G) into the control canonical form if and only if the 
system is controllable. 


Let’s take a closer look at the control canonical form and treat the third-order 
case, although the results are true for any n: 


E >d] —4ü»5 "x3 u l 
F=F, = l 0 Ü J, G = G, =| 0}. (6C.11) 
0 l 0 0 


The controllability matrix, by direct computation, is 


| -a,; a?-a, 
Qy = €,. =| 0 l — ‘ (66.12) 
0 0 1 


Since this matrix is upper triangular with ls along the diagonal, it is always invert- 
ible, as was mentioned earlier. Also note that the last row of 6x is the unit vector 
with all Os, except for the last element, which is unity. We shall use this fact in 
the sequel. 

As we pointed out in Section 6.3, the design of a control law for the state x 
is trivial if the equations of motion happen to be in control canonical form. The 
characteristic equation is 


s+ ais? + aS + a3 = 0, (6C.13) 
and the characteristic equation for the closed-loop system comes from 


Fa = F. — G.K. (6C.14) 
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and has the coefficients, 
s? + (a, + Kads? + (a2 + Keo)s + (as + Ka) = 0. (6C.15) 


To obtain the desired closed-loop pole location, the coefficients of this equation 
are to match 


a-(s) = s? + as? + as +43, (6C. 16) 
and we see that 
@ + Kj = a, a2 + Ka = an, a3 + K.3 = a3, (6C. 17) 
or, in vector form, 
a +K. =a, (6C.18) 


where a and œ are row vectors containing the coefficients of the characteristic 
polynomials of the open-loop and closed-loop systems, respectively. 

We need to find a relationship between these polynomial coefficients and the 
matrix F. The requirement is achieved by the Cayley-Hamilton theorem, which 
states that a matrix satisfies its own characteristic polynomial. For F., we have 


F” + aF”! + aF"? € «c a,IT = 0. (6C.19) 


Suppose we form the polynomial a,(F), which is the closed-loop characteristic 
polynomial with the matrix F substituted for the complex variable s: 


a(F.) = F” +a, F”! + aF? + + oH. (6C.20) 
If we solve Eq. (6C.19) for F? and substitute in Eq. (6C.20), we find that 
a(F.) = (7a; + a)E? ! + (Ca; + a) F”? * --- -(-a, +a,)I. (6C.21) 


But, because F, has such a special structure, we observe that if we multiply it by 


the transpose of the nth unit vector, eT = [0 0 --- 0 1], 
et [= [0 -= 1 Ol]sel; (6C.22) 
as we can see from Eq. (6C.11). If we multiply this vector again by F,, 
(e;F)F. = [0 = 1 OF =(0 0 = 1 0 O]- ei. (6C.23) 
and continue the process, the successive unit vectors are generated until 
eE!z[g] 0 < 0]= ef. (6C.24) 


Therefore, if we multiply Eq. (6C.21) by eT, we find 
ela (F.) = (—a, + ael d (—do t a;)el + 
c dua [EE = Ky - S059 


where we use Eq. (6C.18), which relates K. to the a’s and a’s. 
We now have a compact expression for the gains of the system in control 
canonical form as represented in Eq. (6C.25). But we really need the expression 
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for K, that is, the gain on the original state. If u = —K-x, then u = —K,T x, 
so that 


KKT” = ea EJE = eatT PDT —-eT awh), (60290 


where in the last step we use the fact that (T !FT)' = T !F*T and that a, is a 
polynomial, that is, a sum of powers of F.. But from Eq. (6C.9), we see that 


piu T (6C.27) 
so that 
K = el(€,€; eF. (6C.28) 


Now we use the observation made earlier that the last row of €., which is elbe, 
is again eI. We finally obtain Ackermann’s formula: 


K = e[€;a,(F). (6C.29) 


We note again that forming the explicit inverse of É, is not advisable for numerical 
accuracy. Thus, we need to solve b! so that 


ep = ht. (6C.30) 
We solve the linear set of equations 
be, = ef (6C.31) 
and then compute 
K, = bla«F). (6C.32) 


Section 6.2 


6.1 Verify Eqs. (6.12) and (6.13) by writing the differential equations representing the 
two blocks in Fig. 6.5 and combining the result into the proper form. Then use Eq. 
(6.21) to determine the transfer function from Eq. (6.12) (setting M, = 0). 


6.2 For the redefinition of state variables described in Section 6.2.2, derive Eq. (6.16). 
Note that, since p = Tx, we also have that p = Tx and x = T '!p. 


6.3 Consider the system in Fig. 6.65. 


474 Chapter 6 / State-Space Design 


a) Find the transfer function from u and y. 
b) Write the state-variable equations using the state indicated. 


6.4 Using the indicated state variables, find the state-variable representation for each of 
the systems shown in Fig. 6.66. Find the transfer function for each system using 
block-diagram manipulation and matrix algebra. 


6.5 An electric-field transducer that can be used as a microphone or a speaker can be 
described by the following equations: 
d*x dx EA / v 
Mechanical: M —— + B— + K(x — 1) + —|-| = f(t), 
echanica FK 2 x-D0t7 (=) f(t) 
£9 AV y= 2 
x RC 


d 
Electrical: — 
ectrical: — 


where 


mass of the moving plate, 
damping coefficient, 
spring constant, 
separation of plates, 
natural length of spring, 
area of plate, 

voltage across plates, 
force of plate (input), 
bias voltage, 

resistance. 


| ll 


Ly SNe Ree MOE 
ll 


FIGURE 6.66 


(b) 


FIGURE 6.67 
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The output is 


d & Av 
y = R= 
at Xx 
a) Using state variables x; = x, x2 = X, and x3 = v/x, write the equations in 


state-variable form. 

b) Find the equation that describes equilibrium points for x and v if f(t) = 0. 

c) Let the equilibrium points be X and V; find a set of linearized equations about X 
and V. 


Section 6.3 
6.6 Consider the system in Fig. 6.67. 


a) Write a set of equations that describes this system in the standard form x = 
Fx + Gu and y = Hx. 
b) Design a control law of the form 


u = -[K, Kaži 


that will place the closed-loop poles at s = —2 + 2j. 


6.7 Consider the plant described by 


y=[1 3)x. 


a) Draw the block diagram for the plant at the integrator level. 
b) Find the transfer function using matrix algebra. 
c) Find the closed-loop characteristic equation if the feedback is 


1. u = = Ki K2 )x. 
2. u = —Ky. 
6.8 Consider the transfer function 
TUO st+1 
EH S U(s) s?+5s+6° 
a) By writing 

l st+1 
cae ae 3 s+2 
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FIGURE 6.68 


6.9 


6.10 


find a state-space realization of G(s) as a cascade of first order systems [see Fig. 
2.30(a)]. 

b) Using a partial fraction expansion of G(s), find a realization of G(s) as a parallel 
combination of two first order systems [see Fig. 2.30(b)]. 

c) Find a control canonical form realization. 


The equations of motion for an inverted pendulum on a cart are 
Ô = 0 +u; 4 = —ß0- u. 


Find the feedback gain Ķ such that the poles of the closed-loop system are at s = 
—1,-1,-1+ jl. Let x = [0, 0, x, X]? be the state vector. 


Consider the feedback system in Fig. 6.68. Find the relationship between K, T, and 
é such that the closed-loop transfer function minimizes the ITAE criterion for a step 
input. 


Section 6.5 


6.11 


6.12 


6.13 


For each of the transfer functions below, write the state equations in both controller 
and observer canonical form. In each case, draw a block diagram at the integrator 
level and give the appropriate F, G, and H. 


s? -—2 
s?(s? — 1) 
3s +4 
s32-2s t2 


a) 


(control of an inverted pendulum by a force on the cart). 


b) 


A certain process has transfer function G(s) — 4/(s? — 4). 


a) Find F, G, and H for this system in observer canonical form. 

b) If u = —Kx, compute K so the closed-loop poles are located at s = —2 + j2. 
c) Compute L so the estimator-error poles are located at s = —4 + j4. 

d) Give the transfer function u/y of the resulting controller. 


Consider the system 


“21 1 
Wan e-[o mena 


and assume that we are using feedback of the form u = —Kx + r, where r is the 
reference input signal. 


a) Show that (F, H) is observable. 
b) Show that there exists a K such that (F — GK, H) is unobservable. 


FIGURE 6.69 
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c) Compute a K as in (b) such that K = [1, K2]—that is, find K>. 
d) Compute the open-loop and closed-loop transfer functions. What is the unobserv- 
ability due to? 


6.14 The normalized equations of motion for an inertial navigator are 


X1 0 Sr Ol Xj 0 
X2 = l 0 l X2 +|0 u, 
X3 0 0 0 X3 l 
where 
xı = east-velocity error, 
x2 = platform tilt about north axis, 
x3 = north-gyro drift, 


= gyro drift rate of change. 


= 
| 


Design a reduced-order estimator with y = x, as the measurement and the observer- 
error poles placed at —0.1, —0.1. Be sure to provide all the relevant estimator equa- 
tions. 


6.15 The equations of motion for a station-keeping satellite are 


X — 2w% — 9o?x = 0, y -2o0X t 4o?y = u, 
where 
x — radial position perturbation, 
y — azimuthal position perturbation, 
u = engine thrust in y direction. 


a) Is the system observable from y? 
b) Design a full-order observer with its poles placed at s = —2w, —3w, —3w + j3o. 
Choose x = [x, X, y, y]? as the state vector and y as the measurement. 


6.16 The equations of motion of the simple pendulum in Fig. 6.69 are 


0 4 0?0 = u. 
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FIGURE 6.70 


6.17 


a) Write the equations of motion in state-space form. 

b) Design an estimator (or observer) that reconstructs both state variables of the 
pendulum given measurements of 0. Assume w = 5 rad/s and pick the estimator 
roots to be ats = —10 + 107). 

c) Write the transfer function of the estimator between the measured value of 0 and 
the estimated value of 0 (or 6). 

d) Design a controller (that is, determine K), so that the roots are at s = —4 + 4j. 

e) Find the transfer function for the compensator. 


The longitudinal motions of a helicopter near hover (Fig. 6.70) can be modeled by 
the third-order system, 


à —0.4 0 -00l][q 6.3 
6|-| 1 0 0 0/-| 0 |, 
i -14 9.8 -0.02]| u 9.8 


where 


q = pitch rate, 

= pitch angle of fuselage, 
u = horizontal velocity, 
ô = rotor tilt angle. 


Suppose our sensor measures the velocity as y = u. 


a) Find the open-loop poles. 

b) Is the system controllable? 

€) Assign the poles of the system at s = —2,s = —1 + jl and determine the 
feedback gain K. 


Vertical 


Fuselage reference 
axis 


Rotor thrust 


FIGURE 6.71 


6.18 


6.19 


6.20 


6.21 


Problems 479 


d) Design a full-order estimator to place the estimator poles at —1.5. and -0.5+ j1. 

e) Design a reduced-order estimator to place the poles at — 1. What are the advantages 
and disadvantages of this reduced-order estimator? 

f) Compute the compensator transfer function using the controller in (c) combined 
with the estimator in (d). Repeat for the estimator in (e). 


Consider the system with the transfer function 


G(s) = 


9 
$2—9' 


a) Find (Fo, Go, Ho) for this system in observer canonical form. 

b) Is (Fo, Go) controllable? 

c) Compute K so that the closed-loop poles are assigned at s = —3 + j3. 

d) Is the system observable? 

e) Design a full-order estimator such that the estimator-error poles are located at 
s= —6+Ł j6. 

f) Suppose the system has a zero such that 


9(s + 1) 
G(s) € y2 a e 
Prove that if u = —KXx + r, there is a feedback gain K such that the system is 


unobservable. 


Explain how the controllability, observability, and stability properties of a linear system 
are related. 


Consider the electric network shown in Fig. 6.71. 


a) Write the internal (state) equations for the network. The input u(t) is a current and 
the output y is a voltage. Let x; = i; and x2 = ve. 

b) Let R? = L/C. Is the system controllable? 

c) Let R? = L/C. Is the system observable? 


A block diagram of a feedback system is shown in Fig. 6.72. The state is 
x = x) $ 
af 
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FIGURE 6.72 


the input is r, and the output is y. The dimensions of the matrices are 


F=nxXn L=nx1l 
G-^nxl x—2nx]l 
H-^1xn r=1x1 
K=1Xn y=1x1. 


a) Write the equations in state-variable form. 


b) Let x = TZ, where 
I 0 
r-[! B 


and show that the system is not controllable. 
c) Write the transfer function of the system from r to y. 


6.22 This problem is intended to give you more insight into controllability and observ- 
ability. Consider the circuit in Fig. 6.73, with a voltage source of u(t) and an out- 


put y(t). 


FIGURE 6.73 


FIGURE 6.74 
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a) Using the capacitor voltage and inductor current as state variables, write the state 
and output equations of the system (single-input and single-output). 

b) Find the conditions relating R;, R2, C, and L such that the system is uncontrollable. 
Find a similar set of conditions such that the system is unobservable. 

c) Interpret these conditions physically in terms of the time constants of the system. 

d) Find the transfer function of the system. Show that there is a pole-zero cancellation 
when the system is uncontrollable or unobservable. 


6.23 Two pendulums, coupled by a spring, are to be controlled by two equal and opposite 


forces u, which are applied to the pendulum bobs shown in Fig. 6.74. The equations 
of motion are 


ml’, = —ka?(0, — 02) — mgl, — u, 
ml?0, = —ka?(0; — 0,) — mglO + u. 


a) Show that the system is uncontrollable. Can you associate a physical meaning with 
the controllable and uncontrollable modes? 
b) Is there any way at all that the system can be made controllable? 
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FIGURE 6.75 


Gas jet 
K=kd 


6 =—w"61—K(01—09)+F 
§9=—w09+K(01—09)—F 


6.24 Consider the system in Fig. 6.75. 


a) Write the equations in state-variable form, using [0 ;, 02, 6, 6,]7 as the state vector 
and F as the single input. 


b) Show that all the state variables are observable with y = 6. 
c) Show that the characteristic equation for the system is the product of two oscillators 
by first converting the system equations to the new state variables 


yı 6, +0 
ya. 0; = 02 
» 0; T 02 
y2 0; — 6; 
Hint: If A and D are invertible matrices, then 
A 0|". Jam o 
0 D 0 D^ 


d) Deduce that the "spring mode" can be controlled with F but that the “pendulum 
mode” is uncontrollable with F. 


6.25 The linearized equations of a satellite are 


x = Fx + Gu, 
y = Hx, 
where 
0 1 0 0 0 0 
39)? 0 0 2o 1 0 
in 0 0 0 1/!' G= 0 0l’ 
0 -29 0 0 0 1 
—TI4. 0 9-0 Uy yi 
SUPR eit ue ual y= D» 


FIGURE 6.76 
(a) Series; (b) parallel; 
and (c) feedback. 
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u, u» are the radial and tangential thrusts, respectively. x, and x3 are the radial and 
angular deviations from the reference (circular) orbit, respectively. y1, y» are the radial 
and angular measurements. 


a) Show that the system is controllable using both controls. 

b) Show that the system is controllable with only one control. Which one is it? 

c) Show that the system is observable using both measurements. 

d) Show that the system is observable using only one measurement. Which one is it? 


6.26 Consider the system shown in Fig. 6.76, employing series, parallel, and feedback con- 
figurations. 


a) Suppose we have controllable-observable realizations for each subsystem: 
x; = Fix; + Giu;, 
yi = Hixi, 
i = 1,2. 


Ny(s) |17u2 
Gil8)= ps) 


(a) 


y=yitye 
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6.27 


6.28 


6.29 


6.30 


Write down a state-space realization for each system. 
b) Determine under what conditions each system is controllable and/or observable. 


Output controllability. In some practical control systems, the control engineer may be 
interested in controlling the output y rather than the state x. A system is said to be output 
controllable if at any time one is able to transfer the output from zero to any desired output 
y* using an appropriate control signal u * (ina finite time). Derive necessary and sufficient 
conditions for a continuous system (F ,G ,H) to be output controllable. Are output and state 
controllability related? 


Consider the system 


0 4 0 0 0 

-1 -4 0 0 0 
=| s * 3 g|" r" 

0 0 3 -3 0 


a) Find the eigenvalues of this system. (Note the triangular structure.) 
b) Find the controllable and uncontrollable modes of this system. 
c) For each of the uncontrollable modes, give a V such that 


V'G = 0, yF = AV". 


d) Show that there is an infinite number of feedback gains K that will relocate the modes 
of the system to —5, —3, —2, —2. 

e) Find the unique K that achieves these locations and prevents initial conditions on the 
uncontrollable part from ever affecting the controllable part of the system. 


A state-space model for a paper machine in a certain application had 


0.174 0 0.0 0 


0.157 0.645 0 0 O 
F = 0 l 0.90. 0/, 
0 0 1 0 0 
0 0 0 1 9 
—0.207 
—0.005 
G = 0 ; H=[1 00 0 0). 
0 
0 


a) Draw a block diagram of the system at the integrator level. 

b) A student has computed det € = 2.3 x 1077 and claims that the system is uncontrol- 
lable. Is she right or wrong? Why? 

€) Is the realization observable? 


Consider the system y + 3y +2y = ú + u. 


a) Give F., G., and H, in controller canonical form. 

b) Sketch the eigenvectors of F, in the (x ;, x 2) plane and the completely observable (x) 
and completely unobservable (x5) state variables in orthogonal form. 

c) Express xo and x; in terms of the observability matrix C. 

d) Repeat the problem for controllability instead of observability. 
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6.31 Staircase algorithm (Van Dooren et al., 1978). Any realization (F,G,H) can be trans- 


formed by an orthogonal similarity transformation to (F, G, H), where F is an upper- 
Hessenberg matrix (one nonzero diagonal above the main diagonal): 


Q1 0 
O 0 
F = T'FT = ; G=TG=]|:|; 

; 0 
* "s Q,—| 

81 

H = HT = [hy ..., fel: 21 # 0; T, 
a) Provethatifa; = Oandaj+\,...,@,-1 # O,then the controllable and uncontrollable 


modes of the system can be identified. 

b) How would you use this technique to identify the observable/unobservable modes of 
(F, G, H)? 

c) What is the advantage of this approach over transforming the system to any other 
form for determining the controllable and uncontrollable forms? 

d) How can we use this approach to determine a basis for the controllable/ 
uncontrollable subspaces, as in Problem 6.30? This algorithm can be used to design a 
numerically stable algorithm for pole-placement (see Minimis and Paige, 1982). The 
name of the algorithm comes from the multi-input version in which the & ;’s are the 
blocks that make F resemble a staircase. 


6.32 To control the inverted pendulum by a DC drive motor with current U we have the 
equations 


6=0+V+U, 
V=0-V-U, 
where @ is the angle of the pendulum and V is the velocity of the cart. 


a) We wish to control 0 by feedback to U of the form 
U = —K,0 — Kb — K3V. 


Find the gains so that the resulting poles are located at —1, —1 + j eid . 

b) Assume that 0 and V are measured. Construct an estimator for 0 and @ in the form 
& = FR + L(y — $), wherex = [0 0]' andy = 6. Treat Vand U as both known. 
Select L so the error system has poles at —2, —2. 


6.33 Consider the motor control of G(s) = 10/[s(s + 1)]. 


a) Lety = x; and X, = x2. Complete the state equation by writing X. 
b) Find K; and Kə sou = -—Ki;x,; — K»;x; gives closed-loop poles at o, = 3, 
= 0.5. 

c) Find L; and L, of a state estimator so that the state-error equations have characteristic 
equation with o; = 15,4, = 0.5. 

d) What is the transfer function of the controller obtained by combining (b) and (c)? 

e) Sketch the root-locus of the resulting closed-loop system as plant gain (nominally 10) 
is varied. 
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6.34 


6.35 


6.36 


In controlling an upside-down pendulum (as with a rocket), one aspect requires that we 
control the unstable equations (normalized) 


X— xu. 
a) Letu = —K x, and sketch the root locus with respect to K. 
b) Let 
sra 
U(s) = K- n 19^ 6). 


Select a and K so that the system will display a rise time of about 2 s and no more than 
25% overshoot. Sketch the root locus versus K for your design. 

€) Sketch the Bode plot of the uncompensated plant, both amplitude and phase. 

d) Sketch the Bode plot of the closed-loop design and estimate the phase margin. 

e) Design an estimator for x and X using measurement of x — y and selecting the L 
matrix so that the € equation has characteristic roots at ¢ = 0.5, w,„ = 8. (Note that 
there is no K in this part.) 

f) Draw the block diagram of your estimator, and show where € and x appear. 


Consider the pendulum problem with g// = 4: 
6+40=T!+T). 

Assume there is a potentiometer at 0 that measures the output angle 6, but that it includes 
a constant, but unknown, bias b—that is, z = 0 + b. 
a) Taking the "augmented" state vector to be 

0 

0 

b 

write the system equations in state form. Indicate F, G, H, and G}. 


b) Show, using state-variable methods, that the characteristic equation is s(s*+4) = 0. 
c) Show b is observable with z and write the estimator equations for 


qo ni D 


Pick estimator gain L to place the roots of the estimator-error characteristic equation 
a=2, =Z 

d) Using full-state feedback of the estimated state, derive a control law to place the closed- 
loop poles at —2 + 2j, —1. 

e) Draw a block diagram of the six-state system, that is, estimator, plant, and control law, 
using six integrator blocks. 


A certain fifth-order system is found to have a characteristic equation with roots at 
[0, —1, 7-2, -1 + j1]. A decomposition into controllable and uncontrollable parts dis- 
closes that the controllable part has a characteristic equation with roots at [O, —1 + j1]. 
A decomposition into observable and nonobservable parts discloses that the observable 
modes are at [O, —1, —2]. 


FIGURE 6.77 


FIGURE 6.78 
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a) Where are the zeros of b(s) = Hadj(sI — F)G for this system? 
b) Where are the poles of the reduced transfer function of this system? 


Section 6.6 


6.37 


6.38 


A simplified model for the control of a flexible robotic arm is shown in Fig. 6.77, where 
k/M = 900 rad/s. 


a) Write the equations of motion in state-space form. (Output is y, the mass position; 
input is u, the position of the end of the spring.) 

b) Design an estimator with roots at s = —100 + 100j. 

c) Could both state variables of the system be estimated if only a measurement of y was 
available? 

d) Design a controller with roots at s = —20 + 20j. 

e) Would it be reasonable to design a controller for the system with roots at s = —200 + 
200 j? State your reasons. 

f) Write down the equations representing the compensator. Include a command input for 


y. 


The equations of motion of two cascaded tanks (see Fig. 6.78) linearized about nominal 
levels are 


6h, t a6h, du, 
8h; + cbh> = aóh,, 
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FIGURE 6.79 


6.39 


where 


65h, = deviation of depth in tank | from nominal level, 
ôh = deviation of depth in tank 2 from nominal level, 
ôu = deviation in fluid inflow rate to tank 1 (control). 


a) Level controller for two cascaded tanks. Using state-feedback of form 
ôu = —K,6h, — K26ho, 
choose K, and Ķ: to place the closed-loop eigenvalues at 
s = —20o(l + j). 


b) Level estimator for two cascaded tanks. Only the deviation in level of tank 2 is mea- 
sured (that is, z = ôh2). Using this measurement, design the logic for an estimator 
that will give continuous, smooth estimates of the deviation in levels of tank | and 
tank 2, such that the estimate errors have eigenvalues —30(1 + j). 

c) Estimator/controller for two cascaded tanks. Combining the estimator of (b) with the 
controller of (a) (that is, using estimated-state feedback), sketch a block diagram of 
the controlled system (at the detailed individual-integrator level). 


The lateral motions of a ship that is 100 m long, moving at a constant velocity of 10 
m/s, are described by 


B —0.0895 —0.286 O0][B 0.0145 
F|-|-0.0339 —0272 O || r | +| —0.0122] 6, 
Y 0 ] ojl v 0 


where f is the sideslip angle, r is the yaw rate, and w the heading angle. 


a) Determine the transfer function from ô to y and the characteristic roots of the uncon- 
trolled ship. 
b) Using complete state feedback, 


6 = —K,B — Kr — Kx = Ya), 


where yz is the desired heading, determine K ,, K2, and K ; to place the closed-loop 
roots ats = —0.2, —0.2 + j0.2. 

c) Design an estimator using a measurement of y (obtained from a gyrocompass). Place 
the roots of the estimator-error equation at s = —0.4, —0.4 + 0.4j. 

d) Write out the complete equations that correspond to the “compensation” of this system. 
In other words, specify the box labeled D, in Fig. 6.79. 


6.40 
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A reasonable alternative to the selection of feed-forward gain N in Eq. (6.147) is to 
select N such that when r and y are both unchanging, the DC gain from r to u is 
the negative of the DC gain from y to u. Derive a formula for N based on such a se- 
lection. Show that if the plant is type I, this choice is the same as that given by Eq. 
(6.147). 


Section 6.9 


6.41 


6.42 


6.43 


6.44 


Assume the linearized and time-scaled equation of the ball-bearing levitation device is 
X — x = u + w. Here w is a constant bias due to the power amplifier. Introduce in- 
tegral error control and select three control gains K so that the closed-loop poles are 
at —1 and —1 + j and the steady-state error to w and to a position command will be 
zero. Let y = x andr £ Yref be a constant. Draw a block diagram of your design show- 
ing locations of the K;. Assume that both x and x can be measured. 


A plant is described by the matrices 
-— -0 1 
F=| 5 _9|? G=| 1); H-[1 3]. 
a) Find K such that, if u = —Kx + Nr, the closed-loop system has poles at —2 + j2. 
b) Find N so that, ifr = re = constant, y = ye = Tæ; that is, there is 


zero steady-state error. Show that this property (zero steady-state error) is not robust 
with respect to changes in F. 

c) Add to the plant equation in integrator 7 = e = y — r and select gains K, K ; so 
that, if u = —Kx — Kın, the closed-loop poles are at —2, —1 + jv3. Show that 
this system has zero steady-state error and that this property is robust with respect to 
changes in F so long as the closed-loop system remains stable. 


Consider a system with 
—2 1 l 
r-(2 4): el wena 
a) Use feedback of the form u(t) = —Kx(t) + Nr(t), N being a nonzero scalar, to 


move poles to —3 + 73. 
b) Choose N so that if r is a constant, the system has zero steady-state error, that is, 
y(m) = p, 
€) Show that if F changes to F + ôF, ôF being an arbitrary 2 X 2 matrix, subject to 
F + ôF — GK being stable, then the above choice of N will no longer make y(%) = r. 
Therefore the system is not robust under changes in the system parameters F. 
The system can be made robust by augmenting it with an integrator and using 
unity feedback, that is, € = r — y, where £ is the state of the integrator. To see 
this, first use state feedback of the form u = —Kx — K,£ so that the poles of the 
augmented system are at —3, —2 + j Jd. 
e) Show that the resulting system will have y(#) = r no matter how the matrices 
[F, G, K, K,] are changed so long as the closed-loop system remains asymptotically 
stable. 


d 


— 


Consider the servomechanism to follow the data track on a computer-disk memory 
system. The data track is not exactly a centered circle. Therefore, the radial servo 
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must follow a sinusoid input of radian frequency wọ. The matrices are 


O. 1 0 
r= l? G= at H=[1 3] 
and? = —wr. Place the poles of the error system at 


a.) = (s +1 + jV3Xs + V3 + j1) 
and the pole of the reduced-order estimator at 
a-(s) = s 2. 


Draw a block diagram of the system and clearly show the presence of the oscillator with 
frequency wọ (the internal model) in the controller. Verify the presence of the blocking 
zeros at + jwo. 


Section 6.10 


6.45 Consider the system 


l 


I= SG * DG 2) 


The Smith compensator for e ^ G(s) is given by 


l 


P) 7 TE NGS) 


Investigate the frequency-response properties of the compensator for T = 5. (Problem 
given by Åström, 1977.) 


"m 


Control-System 
Design: 
Principles and 


Case Studies 


Introduction 


In Chapters 4, 5, and 6 we have presented techniques for the analysis and design 
of feedback systems based on root locus, frequency response, and pole placement 
using state-variable models. In this chapter we return to the theme of Chapter 3 to 
reconsider the overal] problem of control-system design, but now with these more 
sophisticated tools in hand. After a discussion of the general, problem setting, 
several characteristic problems are presented in something of a case-study format 
to illustrate the use of all the tools we have developed for control-system analysis 
and design. 


7.1.1 An Outline of Control-System Design 


Control engineering is an important part of the design process of many dynamic 
systems. As suggested in Chapter 3, the deliberate use of feedback can stabilize 
an otherwise unstable system, reduce the error due to disturbance inputs, and reduce 


49] 
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the sensitivity of a closed-loop transfer function to small variations in internal 
system parameters. In those situations where feedback control is required, it is 
possible to outline an approach to control design that will often lead to a satisfactory 
solution. However, before giving our outline, it is important to emphasize that the 
purpose of control is to aid the product or process—the mechanism, the robot, 
the chemical plant, the aircraft, or whatever—in doing the job. It is interesting 
that others engaged in the design process are increasingly taking into account the 
contribution of control early on in their planning so that more and more systems 
simply will not work without feedback. This is especially significant in the design of 
high-performance aircraft, where control has taken its place along with structures 
and aerodynamics as an essential element for the craft even to fly at all. It is 
impossible to give a description of such overall design in this book, but recognition 
of its existence places in perspective not only the specific task of control design 
but also the central role this task can play in an enterprise. 

Control design begins with a proposed product or process whose satisfactory 
dynamic performance depends upon feedback for stability, disturbance regulation, 
or reduction of the effects of parameter variations. We will give an outline of the 
design process that is general enough to be useful whether the product is an elec- 
tronic amplifier or a large space structure. Obviously, to be so widely applicable, 
our outline will be vague with respect to physical details and specific only with 
respect to the feedback-control problem. 


STEP 1: Understand the process and translate dynamic performance requirements 
into time, frequency, and pole-zero specifications. The importance of understanding 
the process, what it is intended to do, how much system error is permissible, how to 
describe the class of command and disturbance signals to be expected, and what the 
physical capabilities and limitations are: all of these can hardly be overemphasized. 
Regrettably, in instructional texts, one tends to view the “process” as a linear, time- 
invariant transfer function capable of responding to inputs of arbitrary size, and to 
overlook the fact that this is a gross caricature valid only for small signals, short 
times, and particular environmental conditions. The designer must not confuse the 
caricature with reality, but must be able to use the simplified model for its intended 
purpose and to return to an accurate physical model or the actual system for real 
verification of the design performance. 

A typical result of this step is a specification that the system have: a step 
response inside some constraint boundaries such as shown in Fig. 7.1(a), an open- 
loop frequency response satisfying constraints such as those sketched in Fig. 7.1(b), 
or closed-loop poles to the left of some constraint boundary such as that sketched 
in Fig. 7.1(c). 


STEP 2: Select a sensor. In sensor selection one must consider which variables are 
important to control and which variables can physically be measured. For example, 
in a jet engine there are critical internal temperatures that must be controlled but 
that cannot be measured directly in an operational engine. One must select sensors 


FIGURE 7.1 

(a) Time-response 
specifications; 

(b) frequency-response 
specifications; and 

(c) pole-zero 
specifications. 
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that indirectly allow a good estimate to be made of these critical variables. Also 
important is the consideration of sensors for the disturbance. Sometimes, especially 
in chemical processes, it is beneficial to directly sense a load disturbance, and 
improved performance can be obtained if this information is measured and fed 
forward to the controller. 

Factors that influence sensor selection are 


Technology Electric or magnetic, mechanical, electromechanical, 
electrooptical, piezoelectric 

Functional performance Linearity, bias, accuracy, dynamic range, noise 

Physical properties Weight, size, strength 

Quality factors Reliability, durability, maintainability 

Cost Expense, availability, facilities for testing and main- 
tenance 


STEP 3: Select an actuator. In order to control a dynamic system, one must obvi- 
ously be able to influence the response; the device that does this is the actuator. 
Before a specific actuator is considered, one must sometimes consider which vari- 
ables can be influenced. For example, in a flight vehicle many configurations of 
movable surfaces are possible, and the influence these have on the performance 
and controlability of the craft can be profound. The locations of jets or other torque 
devices are also a major part of the control design of spacecraft. 

Having selected a particular variable to control, other considerations enter, 
such as: 


Technology Electric, hydraulic, pneumatic, thermal, other 
Functional performance Maximum force possible, 
extent of the linear range, maximum speed possible, 
power, efficiency 


Physical properties Weight, size, strength 

Quality factors Reliability, durability, maintainability 

Cost Expense, availability, facilities for testing and 
maintenance 


STEP 4: Make a linear model. Take the best choice for process, actuator, and sensor, 
identify the equilibrium point of interest, and construct a small-signal dynamic 
model valid over the range of frequencies included in the specifications of step 
1. Validate the model with experimental data where possible. In order to be able 
to use all the available tools, the model should be expressed in state-variable and 
pole-zero form as well as in frequency-response form. Many modern computer- 
design software packages perform the transformation from one of these forms to 
the others. 
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STEP 5: Try a simple PID or lead-lag design. Sketch a frequency (Bode plot) 
response and a root locus versus plant gain to form an initial estimate of the 
complexity of the design problem. If the plant-actuator-sensor model is stable and 
minimum phase, the Bode plot is probably the most useful; otherwise the root locus 
shows very important information with respect to behavior in the right-half plane. 
In any case, try to meet the specifications with a simple controller of the lead-lag 
variety, including integral control if steady-state error response requires it. 

Be sure not to overlook feed-forward of the disturbances if the information is 
available. Also consider the effects of sensor noise and consider the alternatives of 
a lead network or a speed (velocity) sensor to see which gives a better design. 

Reevaluate the specifications, the physical configuration of the process, and 
the actuator and sensor selections in the light of the current design and return to step 
| if improvement seems feasible. For example, in many motion-control problems, 
after the first-pass design is tested there are vibrational modes that prevent the 
design from meeting the initial specifications of the problem. It may be possible 
to meet the specifications much more easily by altering the structure through the 
addition of stiffening members or by passive damping than to meet them by control 
strategies alone. An alternative solution may be to move a sensor so it is at a 
node of a vibration mode, thus providing no feedback of the motion. Also, some 
actuator technologies (hydraulic) have many more low-frequency vibrations than 
others (electric). The important point is that all parts of the design, not only the 
control logic, need to be considered to help meet the specifications in the most 
cost-effective way. 

If the design now seems satisfactory, go to step 7; otherwise try step 6. 


STEP 6: Try an optimal design. If the trial-and-error compensators do not give 
entirely satisfactory performance, a design based on optimal control should be 
considered. Draw the symmetric root locus; select locations for the control poles 
that meet the response specifications; select locations for the estimator poles that 
represent a compromise between sensor and process noise. Plot the corresponding 
open-loop frequency response and the root locus to evaluate the stability margins 
of this design and to estimate its robustness to parameter changes. Modify the pole 
locations until a “best” compromise is obtained. 

Compare the optimal design that has satisfactory frequency response with the 
simple design of step 5. Select the better one and go to step 7. 


STEP 7: Build a computer model and compute (simulate) the performance of the de- 
sign.* When the best compromise between process modification, actuator selection, 
and sensor choice is obtained, a computer model of the system should be run that 


*Extensive computer software is available to assist in this difficult but critical step. Names of just 
a few of these packages are MODEL-C (Systems Control Technology), SIMNON (Lund Institute of 
Technology, Lund, Sweden), ACSL (Mitchell and Gauthier), DSL (IBM), EASYS (Boeing Computer 
Services), MATRIX,, (Integrated Systems, Inc.). 
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includes important nonlinearities such as actuator saturation, noise, and parameter 
variations that are expected during operation of the system. Such a simulation of 
the design will confirm stability and robustness and allow one to predict the true 
performance to be expected from the system. As part of this simulation one can 
often include parameter optimization whereby the computer can be used to “tune” 
the free parameters for best performance. In the early stages, a simple model is 
simulated; as design progresses, more complete and detailed models are studied. If 
the results of the simulation prove the design satisfactory, go to step 8; otherwise 
return to step 1. 


STEP 8: Build a prototype. As the final test before production, a prototype can be 
built and tested. At this point the quality of the model will be verified, unsuspected 
vibration and other modes will be discovered, and ways to improve the design can 
be suggested. After these tests, one might want to reconsider the sensor, actuator, 
and process and conceivably could return to step 1—unless time, money, or ideas 
have run out. 

This outline is an approximation of good practice; other engineers will have 
variations on these themes. In some cases, engineers may wish to carry out the 
steps in a different order, to omit a step, or to add one. The step of simulation and 
prototype construction varies widely, depending on the nature of the system. For 
systems where a prototype is difficult to test and rework (e.g., a satellite) or where a 
failure is dangerous (e.g., active stabilization of a high-speed centrifuge or landing a 
human on the moon), most of the design verification will be done by a simulation of 
some sort. It may be in the form of a digital numerical simulation, a laboratory-scale 
model, or a full-size laboratory model with a simulated environment. For systems 
that are easy to build and modify (e.g., an automotive feedback fuel system), the 
simulation step is often skipped entirely. Design verification and refinement are 
accomplished by working with prototypes. 

Implicit in the process of design is the well-known fact that designs within a 
given class often draw upon experience gained from earlier models, and thus good 
designs evolve rather than appear in the best form the first time. To illustrate the 
method, a few cases will be discussed. For easy reference, a summary of the steps 
is repeated here. 


. Understand the process and its performance requirements. 
. Select the best sensor, considering location, technology, and noise. 


1 
2 
3. Select the best actuator, considering location, technology, and power. 
4. Make a linear model of the process, actuator, and sensor. 

5 


. Make a simple trial design based on lead-lag or PID ideas. If satisfied, go to 
step 7. 


6. Make a trial pole-placement design based on optimal control or other criteria. 


FIGURE 7.2 
A satellite problem. 


1.2 
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7. Simulate the design, including effects of nonlinearities, noise, and parameter 
variations. If the performance is not satisfactory, go to step 1. 


8. Build a prototype and test it. If not satisfied, go to step 1. 


Design of a Satellite’s Attitude Control 


Our first example is taken from the space program and is suggested by the need to 
control the pointing direction, or attitude, of a satellite in orbit about the earth. We 
will go through each step in our design outline and touch on some of the factors 
that might be considered for such a system. 


STEP 1: Understand the process and its performance specifications. A sketch of 
the satellite is shown in Fig. 7.2. We imagine that the vehicle has an astronom- 
ical survey mission that requires accurate pointing of a scientific sensor package 
that must be maintained in the quietest possible environment, isolated from the 
vibrations and electrical noise of the main service body, which contains power 


02 
Model 


(s : Oe 


J161+d(61—62)+k(01—02)=T, 
Jo6o+d(bg—61)+k(02—03)=0 
T,=control torque 
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supplies, thrusters, and communication gear. The resulting structure is modeled as 
two masses connected by a flexible boom. 

Disturbance torques due to solar pressure, micrometeorites, and orbit pertur- 
bations are computed to be negligible. The pointing requirement can be met by 
dynamics with a transient settling time of 14 s and an overshoot of 15%. The 
satellite will be overhead for about 10 min, and 14 s is considered adequate speed 
of response for the mission. 


STEP 2: Select a sensor. In order to orient the scientific package, it is necessary 
to measure the attitude angles of the vehicle. For this purpose, a system based on 
gathering an image of a specific star and keeping it centered on the focal plane 
of a telescope is selected. This sensor gives a relatively noisy but very accurate 
(on the average) reading proportional to 0, the angle of deviation from the desired 
angle. To stabilize the control, a rate gyro is included to give a clean reading of Ô, 
since a lead network on the star tracker would have too much noise. Furthermore, 
the rate gyro could stabilize any large motions without requiring the star tracker to 
acquire the target. 


STEP 3: Select an actuator. Major considerations in the actuator selection are pre- 
cision, reliability, weight, power requirements, and life-span. Alternatives for ap- 
plying torque are cold-gas jets, reaction wheels or gyros, magnetic torquers, and 
gravity gradient. The jets have the most power and are the least accurate. Reaction 
wheels are precise but can only transfer momentum, so jets or magnetic torquers 
are required to dump momentum from time to time. Magnetic torquers provide 
relatively low levels of torque and are suitable for some low-altitude satellite mis- 
sions. Gravity gradient also provides a very small torque that limits the speed of 
response and places severe restrictions on the shape of the satellite. For purposes 
of this mission, cold-gas jets are selected as being fast and adequately accurate. 


STEP 4: Make a linear model. For the satellite we assume two masses connected 
by a spring with torque constant k and viscous damping constant d. The equations 
of motion from Fig. 7.2 are 


Ji0; + d(0, — 02) + k(0; — 02) = Te, 
Jað + d(04 — 61) + k(05 — 61) = 0, 0 


where T, is the control torque. With inertias J; = 1 and J2 = 0.1, the transfer 
function is 


10ds + 10k 


OW) SE dsl 


(7.2) 


If we choose as the state vector, 


x! = [0; 0; 0, 6j] 
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then, from Eq. (7.1), the equations are (with T, = u) 


0 l 0 0 0 
EE o£ 
v — 2 2 2 2 if. 
* 0 p-p [IRI ger 
k d E 4. b 5 
T T$ ye, 7 T 
y=[1 0 0 Ox. (7.3) 


Physical analysis of the boom leads us to assume that the k and d parameters vary 
as a result of temperature fluctuations but are bounded by 


0.09 = k - 0.4, 


k k 
et So ee, 
0.04. | d 02. [cs (7.4) 


As a result, the vehicle resonance w, can vary between | and 2 rad/s, and the 
damping ratio ¢ varies between 0.02 and 0.1. The approach to design when pa- 
rameters are subject to variation is to select nominal (“worst-case”) values for the 
parameters and to construct the design so that no possible value of the parameters 
can cause the specifications to be missed. In the present case, we select the nominal 
model to have w, = 1 (the lowest value) and ¢ = 0.02 (also the lowest value). 
These correspond to the parameter values k = 0.091 and d = 0.0036, and with 


J; = land J2 = 0.1, the nominal equations are 
0 l 0 0 0 
mee —0,91 -0036 0.91 0.036 r24 0 
0 0 0 l 0 (7.5) 
0.091 0.0036 —0.091  —0.0036 l 
y=[1 0 0 0]x. 
The corresponding transfer function is 
0.036(s + 25 
G(s) = sra (7.6) 


s?(s + 0.02 + jl) 


When a trial design is completed the computer simulation will be run with the range 
of parameter values to ensure that the design has adequate robustness to tolerate 
these changes. 

The dynamic performance specifications will be met if the closed-loop poles 
have an w, = 0.7 rad/s and a closed-loop damping ratio of 0.5; these correspond 
to an open-loop crossover frequency of we = 0.5 rad/s and a phase margin of 
about 50°. 
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FIGURE 7.3 
Root locus for KG(s). 
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STEP 5: Try a lead-lag or PID controller. The proportional gain root locus for the 
nominal plant is drawn in Fig. 7.3, and the Bode plot is given in Fig. 7.4. 

In order to illustrate some important aspect of compensation design, we will 
imagine that the designer first ignores the resonance and generates a design for 
the rigid body alone. Taking the process transfer function to be 1/s?, the feedback 
to be position plus derivative (star tracker plus rate gyro) with transfer function 
D(s) = K(sT +1), and the response objective to be w, = 0.7 rad/s and = 0.5, 
a suitable controller is 


Di(s) = 0.5(1.4s + 1). (7.7) 


The root locus is shown in Fig. 7.5 and the Bode plot in Fig. 7.6. From these 
plots it is seen that the low-frequency poles are reasonable but the system would be 
unstable because of the resonance.* One simple action at this point is to reduce our 


*If we were to use the method described in Section 4.6.4 for nonlinear systems, we would expect the 
control to saturate and produce a limit cycle at about 1 rad/s, behavior that would rapidly deplete the 
control gas supply. 


FIGURE 7.4 

Open-loop frequency 
response K G(s) for 

K = 0.5: (a) magnitude 
and (b) phase. 
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FIGURE 7.5 
Root locus for 
KD,(s)G(s). 


A Poles for K=0.5 


FIGURE 7.6 
Frequency response 
for K Di(s)G(s): 
(a) magnitude and 
(b) phase. 
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FIGURE 7.7 
Root locus for 
K D5(s)G(s). 


expectations with respect to bandwidth and slow the system down by lowering the 
gain until the system is stable. With so little damping, we must really go slowly. 
A bit of experimentation leads to 


D»(s) = 0.001(30s + 1), (7.8) 
for which the root locus is drawn in Fig. 7.7 and the Bode plot in Fig. 7.8. From 


the Bode plot we see we have a gain margin of 50° with this design, but a crossover 
frequency of only w = 0.04 rad/s. 


A Closed-loop poles 


FIGURE 7.8 
Frequency response for D2(s)G(s): (a) magnitude and (b) phase. 
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FIGURE 7.9 
Twin-tee realization of a 
notch filter. 


FIGURE 7.10 
Pole-zero map for a 
notch filter. 


Notch 


A more common approach to the problem is to place zeros near the lightly 
damped poles and use them to hold these poles back from the right-half plane. Such 
a compensation has a frequency response with very low gain near the frequency 
of the offending poles and has reasonable gain elsewhere. The frequency response 
seems to have a dent or notch in it, and the device is called a notch filter. (It is 
also called a band reject filter in electric network theory.) An RC circuit having a 
notch characteristic is shown in Fig. 7.9, its pole-zero pattern in Fig. 7.10, and its 
frequency response in Fig. 7.11. 
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FIGURE 7.11 
Frequency response 
of a notch filter: 
(a) magnitude and 
(b) phase. 
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FIGURE 7.12 
Root locus for 
KD3(s)G(s). 
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With this idea we begin with the compensation of Eq. (7.7) and add the notch, 
producing the revised compensator transfer function, 


(s/0.9)* + 1 


D3(s) = 0.5(1.4s + D 5/25) TIE 


(7.9) 


The root locus for this case is shown in Fig. 7.12, the Bode plot in Fig. 7.13, 
and the transient recovery to 05(0) = 0.2 rad in Fig. 7.14. This seems to be a 
satisfactory design and worth checking further for robustness; a more complete 
check will be done later, but a root locus using the compensator of Eq. (7.9) and 
the plant with w, = 2 rather than 1, such that 


(5/50) + 1 


G(s) = 2152/4) + 0.025 + IT 


(7.10) 


as if the boom were as stiff as possible, as shown in Fig. 7.15. Notice that now 
the low-frequency poles have damping of only 0.25. The frequency response is 
shown in Fig. 7.16, and the transient response with the varied parameter values 
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FIGURE 7.13 
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FIGURE 7.14 
Transient recovery for D3(s) 
and G(s): 05(0) = 0.2 rad. 
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FIGURE 7.15 . 
Root locus for KD3(s)G(s). 
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FIGURE 7.16 
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FIGURE 7.17 
Transient recovery for D3(s) and G(s): 62(0) = 0.2 rad. 
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is drawn in Fig. 7.17. We could take a few more iterations of trial and error with 
the notch filter and rate feedback, but the system is complex enough that a look at 
state-space designs seems reasonable. We go to step 6. 


STEP 6: Try an optimal design using pole placement. Using the state-variable for- 
mulation of the equations of motion, we can devise a controller that will place 
the closed-loop poles in arbitrary locations. Of course, used without thought, the 
method of pole placement can also result in a design that requires unreasonable 
levels of control effort or is very sensitive to changes in the plant transfer function. 
Guidelines for pole placement are given in Chapter 6; one approach that is often 


FIGURE 7.18 
Symmetric root locus for 
the satellite. 
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successful is to use optimal pole locations as found via the symmetric root locus. 
For the problem at hand, the symmetric root locus is drawn in Fig. 7.18. From this 
locus, to obtain a bandwidth around 0.7 rad/s we select closed-loop control poles 
at —0.6 + j0.4 and —0.25 + j1.1 and closed-loop estimator poles from the same 
locus at —0.84 + j2.2 and —2.04+ j0.92. These are not selected to be very fast 
in recognition of the noise in the position measurement. 

If we select a, (s), as discussed previously, from the symmetric root locus, the 
control gain is 


K, —[-—0.595 0.275 1.32 1.66], LET) 
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FIGURE 7.19 


Transient recovery: 


6(0) = 0.2 rad. 
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and the transient recovery for 6(0) = 0.2 rad is shown in Fig. 7.19. The esti- 
mator characteristic polynomial, taken from the symmetric root locus, leads to an 
estimator (filter) gain of 


5.73 
_ | 16.42 
L|: (7.12) 


29.98 


If we combine the control and estimation as presented in Chapter 6, the compensator 
transfer function that results is 


pacs) = — 2486 + 0.27)(s + 0.0543 + j0.894) PS 
1 (s 4- 0.676 + j2.88)(s + 3.04 + 71.53) ' 


The frequency response of this compensator is shown in Fig. 7.20. Notice that pole 
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FIGURE 7.20 
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FIGURE 7.21 me) 


Root locus for 
D4(s)G(s). 
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placement has introduced a notch directly. The root locus for this combined system 
is drawn in Fig. 7.21, the Bode plot in Fig. 7.22, and the recovery transient for 
0(0) = 0.2 rad in Fig. 7.23. Notice that the design meets the specification. This 
design will now be checked for robustness. If the resonant modes are shifted to 
€, = 2, as was done for the PD-plus-notch design, we obtain the root locus of 
Fig. 7.24. 

Note that the design is not very robust. This design is based on the assumption 
of noisy measurement of position, whereas the classical design assumes that mea- 
surements of both position and velocity are available. The classical compensator 
has three zeros and two poles, whereas the state-variable compensator has three 
zeros and four poles. The extra two poles of the state-variable design make it less 


FIGURE 7.22 
Frequency response of 
compensated system 
D4(s)G(s): 

(a) magnitude and 

(b) phase. 
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robust (see root locus of Fig. 7.24). We would expect that comparable results could 
be obtained if a reduced estimator is designed assuming a measurement of velocity 
as well as position. 


STEP 7: Simulate the design and compare the alternatives. At this point we have two 
apparently satisfactory designs, with differing complexities and different robustness 
properties. We reconsider the original assumptions in the light of our trial designs. 
Both design methods have been strongly influenced by the presence of the lightly 
damped resonant mode caused by the coupled masses. However, as we saw in 
Chapter 2, the transfer function is a strong function of the fact that the actuator 
is on one body and the sensor is on the other (not collocated). Suppose we can 
satisfy the purposes of the mission by locating the sensor on the same mass that 
holds the actuator—that is, with a collocated actuator and sensor. If the actu- 
ators and sensors are collocated, the situation is drastically different! The system 
has zeros close to the flexible modes, and all the vibration modes can be stabilized 
by using negative rate feedback. This is easily seen from the root locus diagram 
typical of such systems shown in Fig. 7.25. Since control of position is typically 
desired, then direct rate feedback is not sufficient because position is unobtainable 
with a rate sensor. Position feedback with a lead compensator or combined position 
and rate feedback can be used to stabilize all the vibration and rigid-body modes. 
Consider the transfer function of the satellite with collocated actuator and sensor 
(to measure 0j) for which the state matrices are 


0 I 0 0 0 
_|-0.91 -0.036 0.91 0.036 _|0 
"MI E: 0 0 l Su s 
0.091 0.0036 -0.091 —0.0036 I 
H-[0 0 1 0]. (7.14) 


The transfer function of the system is 


(s 4- 0.018 + j0.954) 


A H I = =f SE ——————Á 
Geo(S) (s F) G s?(s + 0.02 + JH 


(7.15) 


Notice the presence of a pair of zeros in the vicinity of the complex conjugate 
poles. If we now use just position-plus-rate feedback, 


Ds(s) = 0.5(1.4s + 1), (7.16) 
then the system will not only be stabilized, but will have satisfactory response, 


because the resonant poles tend to cancel the complex conjugate zeros. Note that 
a notch filter is no longer necessary since the system provides its own notch. The 
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FIGURE 7.25 
Simple control logic with collocated actuator and sensor: (a) rate feedback and (b) position feedback with lead 


compensator. 
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FIGURE 7.26 
Root locus for Ds(s)Geo(s). 


root locus of the system is shown in Fig. 7.26, and the frequency response is 
seen in Fig. 7.27. The result is a very simple, robust design achieved by moving 
the sensor from a noncollocated position to one collocated with the actuator. The 
result illustrates the very important point that, in achieving good feedback control, 
considerations of sensor location as well as technology and other features of the 
physical problem are typically more important than compensator transfer-function 
design. 

Figure 7.28 shows the stability robustness measure (Eq. 5.67) for the satellite 
attitude control where the unstructured (multiplicative) bound on model error is 
described by 


105? 


ts) = s? + 8s + 64’ 
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FIGURE 7.27 


Frequency response 
for Ds(s)Geo(s): 


(a) magnitude and 


(b) phase. 
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FIGURE 7.28 
Stability robustness 


measure for satellite. 


1.3 


7.3 / Lateral and Longitudinal Control of a Boeing 747 520 


Magnitude 


Decibels 


20 40 60 100 


and the compensator is given by Eq. (7.16). Since the stability robustness measure 
remains above the bound on model error at all frequencies, the system is guaranteed 
to be stable for all models in the defined class. 


Lateral and Longitudinal Control of a Boeing 747 


The Boeing 747 is a large, wide-body jet transport airplane. A picture of a Boeing 
747 is shown in Fig. 7.29, and a schematic with the relevant coordinates is shown 
in Fig. 7.30. The linearized equations of (rigid-body) motion for the Boeing 747 
are of eighth-order but are separated into two fourth-order sets representing the 
longitudinal (u, w, q in Fig. 7.30) and lateral motion (8,7, p in Fig. 7.30). The 
longitudinal motion consists of axial, vertical, and pitching motion (see Example 
6.4), while the lateral motion consists of rolling, yawing, and lateral movement. 
The elevator control surfaces and the throttle affect the longitudinal motion, whereas 
the aileron and rudder primarily affect lateral-directional motion. For a straight and 
wings-level reference condition, the coupling of lateral motion into longitudinal 
motion can usually be ignored and the equations of motion are treated as two 
decoupled fourth-order sets for designing the control, or stability augmentation, 


524 Chapter 7 / Control-System Design: Principles and Case Studies 


FIGURE 7.29 
Boeing 747 aircraft. (Courtesy Boeing Commercial Airplane Co.) 


FIGURE 7.30 
Definition of aircraft coordinates. 
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for the aircraft. We will discuss the design of a stability-augmentation system for 
the lateral dynamics, called a yaw damper, and certain aspects of the autopilot 
having influence over the longitudinal behavior. 


7.3.1 Yaw Damper 


STEP 1: Understand the process and its performance specifications. Swept-wing 
aircraft have a natural tendency to be lightly damped in one of the lateral modes 
of motion. At typical commercial-aircraft cruising speeds and altitudes, this mode 
is sufficiently difficult for pilots to control that virtually every swept-wing aircraft 
has a feedback system to help the pilot. The specification of our control system is, 
therefore, to modify the natural dynamics so that the plane is easier for the pilot to 
fly. Studies have shown that pilots like natural frequencies <1 rad/s with a damping 
ratio of ¢ = 0.5. Aircraft with dynamics that violate these guidelines are gener- 
ally considered fatiguing to fly and highly undesirable. Our system specifications, 
therefore, are to achieve lateral dynamics that meet these root constraints. 


STEP 2: Select a sensor. The easiest measurement to take of aircraft motion is that 
of angular rate. Velocities can also be measured using pitot tubes and wind-vane 
devices, but these are noisier and less reliable for stabilization. Two angular rates — 
roll and yaw—partake in the lateral motion. Study of the lightly damped lateral 
mode indicates that it is primarily a yawing phenomenon; thus measurement of the 
yaw rate is a logical starting point for the design. Up until the early 1980s, the 
measurement had been made with a gyroscope, essentially a small, fast-spinning 
rotor that can yield an electric output proportional to the angular yaw rate of the 
aircraft. Since the early 1980s, most new aircraft systems are relying on a laser 
device (called a ring-laser gyroscope) for the measurement. Here, two laser beams 
traverse a closed path (often a triangle) in opposite directions. As the triangular 
device rotates, the apparent frequency of the two beams shifts, and this frequency 
shift is measured, producing a measure of rotational rate. These devices have fewer 
moving parts and are more reliable at less cost than the spinning-rotor variety of 
gyroscope. 


STEP 3: Select an actuator. Two aerodynamic surfaces typically influence the lateral 
aircraft motion: the rudder and the ailerons (see Fig. 7.30). The lightly damped 
yaw mode that is being stabilized by the yaw damper is most affected by the rudder. 
Therefore, use of that single control input is a logical starting point for the design. 
Hydraulic devices are universally employed in large aircraft to provide the force 
that moves the aerodynamic surfaces. No other kind of device has been developed 
to provide the combination of high force, high speed, and light weight that is 
desired for the actuation of the controlling aerodynamic surfaces. On the other 
hand, low-speed flaps, which are frequently used to augment lift during take-off 
and landing, are typically actuated by an electric motor with a worm gear. 
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FIGURE 7.31 
Root locus for yaw damper with direct feedback. 
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STEP 4: Make a linear model. The lateral perturbation equations (Heffley and Jew- 
ell, 1972) of motion in horizontal flight at 40,000 ft and forward speed U = 774 
ft/s (Mach 0.8) are* 


B —0.0558 —0.9968 0.0802 0.0415][ B 0.00729 
j| | 0.598 -0.115 0.0318 0 r|,|-0475 |. 
p -3.05 0.388  —0.4650 0 p (is p 
Ó 0 0.0805 1 0 h 0 
p 
y=[0 1 0 0] " (7.17) 
p 
h 
The transfer function is 
—4.75(s + 0.498)(s + 0.012 + j0.488 
G(s) r(s) _ (s Xs J ) (7.18) 


~ Ór(s) (s 0.00735 + 0.563Ys + 0.033 + j0.947) 


so that the system has two stable real poles, and a pair of stable complex poles 
referred to as the "Dutch roll," the name describing the motions of a person skating 
on frozen canals in Holland. The stable real poles are referred to as the spiral mode 
(s; = —0.0073) and the roll mode (s; = —0.563). From looking at the natural 
roots, we see that the offending mode that needs repair for good pilot handling is 
the Dutch roll, or the roots at s = —0.033 + 70.95. The roots have an acceptable 
frequency, but their damping of ¢ = 0.03 is far short of the desired ¢ = 0.5. 


STEP 5: Try a lead-lag PID design. As a first crack at the design, proportional 
feedback of the yaw rate to the rudder will be considered. The root locus versus 
the gain of this feedback is shown in Fig. 7.31, and its frequency response is shown 
in Fig. 7.32. The figures show that a damping of ¢ = 0.45 is achievable. 

In practice, however, it is found that this simple feedback creates an objection- 
able quality during a steady turn, since it provides a steady rudder input opposite 
the pilot's input due to the steady yaw rate. Control engineers know from experi- 
ence that this dilemma can be solved by the addition of a washout circuit in the 
feedback. The washout circuit has the feature that it passes only transient inputs 


* The unit for B and ó are radians, and for r and p the units are radians per second. 
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FIGURE 7.32 

Frequency response of 
yaw damper with direct 
feedback: (a) magnitude 
and (b) phase. 
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FIGURE 7.33 

Yaw damper: (a) block 
diagram and (b) block 
diagram for analysis. 
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Pilot’s aileron input 


Aircraft 


(a) 


(b) 


and “washes out” steady and low-frequency inputs. Figure 7.33 shows a block 
diagram of the yaw damper with the washout included. 
The transfer function of the washout circuit is 


e(s) _ S 
eyrg(s) os + (MT) 


H(s) = 


The frequency response of the washout circuit is shown in Fig. 7.34(a and b) for 
T = 3 s, and its response to a unit step input is shown in Fig. 7.34(c). The 
root locus of the system with washout circuit is shown in Fig. 7.35. As seen from 
the root locus, with the addition of the washout very little increase in the damping 
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FIGURE 7.34 
Frequency response of the washout circuit: (a) magnitude, (b) phase, and (c) step response. 
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FIGURE 7.35 
Root locus with washout circuit, 7 — 3. 
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ratio can be obtained. The rudder servo represents the actuator dynamics 


ór(s) | 10 
esr(s) s +10’ 


which is fast compared with the dynamics of the system. The root locus of the 
system with washout and actuator dynamics is shown in Fig. 7.36. The associated 
frequency responses of the system are shown in Fig. 7.37. The response of the 
closed-loop system to an initial condition of Bo = 1° is shown in Fig. 7.38 for 
a root-locus gain of unity. The root locus indicates that the maximum achievable 
damping with this feedback scheme is approximately ¢ = 0.3. Although this a 
considerable improvement over the original aircraft, it is not as good as originally 
desired. 
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FIGURE 7.36 
Root locus with washout circuit, 7 = 3, and actuator. 


FIGURE 7.37 


Frequency response of yaw damper, including washout and actuator: (a) magnitude and (b) phase. 
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FIGURE 7.38 
Initial condition response for Bo = 1°. 
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STEP 6: Try an optimal design using pole placement. If we augment the dynamic 
model of the system by adding the actuator and washout, we obtain the state- 
variable model: | 


XA —10 0 0 0 0 | 0 
B 0.00729! —0.0558 —0.997 . 0.0802 0.0415: 0 
+ | — | -0.475 | 0.598 0.1150 -0.0318 0 © 0 
51 0.153 ' —3.05 0.388  —0.465 0 ! 
: 01.0 0.0805 — 1 gard m 
pui IPS belie Pe eee eee ewe ee neese Wm — 
^ti a | 0 l 0 0 ! — 0.333 
XA 10 
B 0 
r 0 
p i 0 esr, 
Q 0 
X wo 0 
XA 
B 
e-[0:0 1 0 0: — 0.333] 4 
h 
X wo 


where es, is the input to the actuator and e is the output of the washout. The 
symmetric root locus for the augmented system is as shown in Fig. 7.39. If we 
select the state feedback poles from the symmetric root locus so that the complex 
roots have maximum damping (¢ = 0.4), we find 


ac(s) = (s + 0.0051)(s + 0.468)(s + 0.279 + j0.628)(s + 1.106)(s + 9.89), 
then the state feedback gain is computed to be 


K = [0.1059 | —0.191 —2.32 0.0992 0.0370 | 0.486]. 
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FIGURE 7.39 
Symmetric root locus of lateral dynamics, including washout filter and actuator. 
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Note that the third entry in K is larger than the others so that the feedback of all 
four states is essentially the same as proportional feedback of r. This is also evident 
from the similarity of the root locus in Fig. 7.31 and the SRL of Fig. 7.39. If we 
select the estimator poles to be five times faster than the controller poles, that is, 


ae(s) = (s + 0.0253)(s + 2.34)(s + 1.39 + j3.14)(s + 5.53)(s + 49.5), 


then the estimator gain is found to be 


FIGURE 7.40 
Initial condition response 
for Bo = 1°, Ro = 0. 
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The compensator transfer function from Eq. (6.113) is 


—844(s + 10.0)(s — 1.04)(s + 0.974 + j0.559)(s + 0.0230) 
(s + 0.0272)(s + 0.837 + j0.671)(s + 4.07 + j10.1)(s + 51.3) 


(7.19) 


D.(s) = 


Figure 7.40 shows the response of the system to an initial condition of o = 1°. It 
is clear from the root locus that the damping can be improved by the SRL approach, 
and this is borne out by the reduced oscillatory behavior in the transient response 
of the system. However, this improvement has come at a considerable price. Note 
that the order of the compensator has increased from 1 in the original design (Fig. 
7.33) to 6 in the design obtained using the controller/estimator/SRL approach. 

Aircraft yaw dampers in use today generally employ a proportional feedback 
of yaw rate to rudder through a washout or through minor modifications to this 
design. The improved performance achievable with an optimal design approach 
utilizing full-state feedback and estimation is not judged worth the increase in com- 
plexity. 
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Perhaps a more fruitful approach to improvement of the design would be to 
add the aileron surface as a control variable along with the rudder. However, this 
approach, too, has not been considered worth its complexity. 


STEPS 7 AND 8: Verify the design. Linear models of aircraft motion are reasonably 
accurate as long as the motion remains close to the reference condition and the 
actuators do not saturate. But since actuators are sized for safety so that they handle 
large transients, their saturation is very rare. The linear analysis-based design is, 
therefore, reasonably accurate, and we will not pursue a nonlinear simulation or 
further design verification. 


7.3.2 Altitude-Hold Autopilot 


STEP 1: Understand the process and its performance specifications. One of the 
pilot’s many tasks is to hold a specific altitude. As an aid to keeping aircraft from 
colliding, those craft on an easterly path are required to be on an odd multiple of 
1000 ft, while those on a westerly path are required to be on an even multiple of 
1000 ft. It is therefore of some concern to the pilot that the altitude be held to 
within a few hundred feet. A well-trained attentive pilot can easily accomplish this 
task to within +50 ft, and this kind of tolerance is what the air-traffic controllers 
expect pilots to maintain. Since this task requires the pilot to be fairly diligent, 
sophisticated aircraft often have an “altitude-hold autopilot” to perform the task. 
This system is fundamentally different from the yaw damper in that its role is 
to replace the pilot for certain periods of time, while the yaw damper’s role is 
to help the pilot fly. Dynamic specifications, therefore, need not be such that 
pilots like the craft's "feel"; instead, the design should provide the kind of ride 
that pilots and passengers like. The damping ratio should still be in the vicinity of 
¢ = 0.5, but, for a smooth ride, the natural frequency should be much slower than 1 
rad/s. 


STEP 2: Select a sensor. Clearly needed is a device to measure altitude, a task 
most easily done by measuring the atmospheric pressure. Almost from the time of 
the first Wright brothers' flight, this basic idea has been used in a device called a 
barometric altimeter. Before autopilots, the device consisted of a bellows whose 
free end was connected to a needle that directly indicated altitude on a dial. The 
same idea is used today, but the pressure is sensed electrically. 

Because altitude control is essentially four integrations from the controlling el- 
evator input, stabilization of the feedback loop cannot be accomplished by simple 
proportional feedback. Therefore pitch rate q is also used as a stabilizing feedback; 
it is measured by a gyroscope or ring-laser gyro identical to that used for yaw-rate 
measurement. Further stabilization from pitch-angle feedback is also helpful. It is 
obtained from either a ring-laser gyro inertial reference system or a “rate-integrating 


7.3 / Lateral and Longitudinal Control of a Boeing 747 539 


gyro,” a device similar to the rate gyro, but structured differently so that its outputs 
are proportional to the angle of the aircraft’s pitch (0) and roll angles (@). 


STEP 3: Select an actuator. The aerodynamic surface typically used for pitch con- 
trol on most aircraft is the elevator, de. It is located on the horizontal tail, well 
removed from the aircraft's center of gravity so that its force produces an angular 
pitch rate and thus angle, which act to change the lift from the wing. In some 
high-performance aircraft, there are "direct-lift" control devices on the wing or 
perhaps small canard surfaces forward of the wing, which produce vertical forces 
on the aircraft much faster than elevators are able to. However, for purposes of our 
altitude hold, we will only consider the typical case of an elevator surface on the 
tail. 

As for the rudder, hydraulic actuators are the preferred device to move the 
elevator surface. 


STEP 4: Make a linear model. The longitudinal perturbation equations of motion 
for the Boeing 747 in horizontal flight, U = 830 ft/s at 20,000 ft (Mach 0.8) with 
a weight of 637,000 lb, are 


u —0.00643 0.0263 0 —32.2 OF R 0 
Ww —0.0941 — 0.624 820 0 Ojj w 32.1 
q| =| —0.000222 —0.00153  —0.668 0 O}) @ | +] —208]| ôg 
6 0 0 l 0 01| 8 0 
h 0 ex 0 830 O1LA 0 
(7.20) 
where the desired output for an altitude-hold autopilot is 
u 
w 
h=[0 0 0 0 IJ q Cal) 
0 
h 
The system has two pairs of stable complex poles and a root at s = 0. The 


complex pair at —0.003 + /0.0098 are referred to as the phugoid mode* and the 
poles —0.6463 + 71.1211 are the short-period modes. 


*The name was adopted by F. W. Lanchester (1908), who was the first to study the dynamic stability 
of aircraft analytically. It is apparently an incorrect version of a Greek word. 
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FIGURE 7.41 
Altitude-hold feedback 
system. 


STEP 5: Try a lead-lag or PID controller. As a first step in the design, it is typically 
helpful to use an inner-loop feedback of q to de so as to improve the damping of 
the short-period mode of the aircraft (see Fig. 7.41). The transfer function from 
de to q is 


q(s) _ —2.08s(s + 0.0105)(s + 0.596) 
de(s) (s + 0.003 + j0.0098)(s + 0.646 + 71.21) 


(7.22) 


The root locus for g feedback using Eq. (7.22) is as shown in Fig. 7.42. Since 
ką is the root-locus parameter, the system matrix (Eq. 7.20) is now modified as 
follows: 


F, = F + k,GH,, (1.23) 


where F and G are defined in Eq. (7.20) and H, = [0 O 1 O OJ]. One 
may pick a suitable gain k, from the root locus. The selection procedure is the 
same one discussed in Chapter 4. (Recall the continuation locus and tachometer 
feedback example in Section 4.6.) If we choose ką = 1, then the closed-loop 
poles are located at —0.0039 + 70.0067, —1.683 + 70.277 on the root locus 
and 


—0.00643 0.0263 0 —32.2 0 
—0.0941 —0.624 787 0 0 

Fa =| —0.000222 -—0.00153  —2.75 U- 4 
0 0 l 0 0 

0 = J 0 830 0 


Note that only the third column of F; is different from F. To add further capabil- 
ity in the autopilot, the pitch angle of the aircraft is typically also controlled. This is 


Compensation 
D..(s) 


FIGURE 7.42 

Root locus for 
longitudinal dynamics 
with g feedback. 
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achieved by feeding back also the pitch angle (0) to elevator control. If we select* 
Kg, = [0 O -0.8 -6 0] 


in order to feedback 0 and q, then the system matrix is 


—0.0064 0.0060 0 -322 0 
—0.0941 —0.624 761 -1962 0 

Fo, = F, — GKo, =| —0.002 -0.00015 —441  —1248 O|, (7.24) 
0 0 l RESA: 
0 -1 0 830 0 


with poles at s = 0, —2.25 + j2.99, —0.531, —0.0105. So far, the inner loop 
of the aircraft has been stabilized significantly. The uncontrolled aircraft has a 


* A design based on SRL would suggest feeding back @ and q at this point. 


FIGURE 7.43 

Response of an attitude- 
hold autopilot to a 
command in 0. 


FIGURE 7.44 
0? root locus with h 
feedback only. 
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FIGURE 7.45 
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natural tendency to return to level attitude as evidenced by the phugoid roots at 
s = —0.003 + 70.0098. This inner stabilization is necessary to enable an outer h 
and h feedback to be successful; furthermore, the @ and q feedbacks can be used 
by themselves in an attitude-hold mode of an autopilot, in which a pilot wishes to 
control 0 directly through input command. Figure 7.43 shows the response of an 
attitude-hold autopilot to a 2° (0.035 rad) step command in @. The transfer function 
of the system is now 


h(s) _ 32.7(s + 0.0045)(s + 5.64)(s — 5.61) 


8e) — 56.2255 j2.99)(s + 0.0105) + 0.053) — U^ 


A sketch of the root locus (Fig. 7.44) shows that feedback of altitude by itself 
does not yield an acceptable design. However, we may also feed back the alti- 
tude rate for stabilization. The root locus of the system with h and h feedback 
is shown in Fig. 7.45. The ratio of h to h found to be best after some iteration 
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FIGURE 7.46 
Symmetric root locus for altitude-hold design. 
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FIGURE 7.47 
Step-response of altitude- 
hold autopilot. 
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is 10:1, 
G(s) = K;(s + 0.1). 


that is, we have placed a new zero. l 

The final design is the result of iterations between the q, 0, h, and h feedback 
gains. Although this trial design was successful, use of the SRL approach has 
promise to expedite the process. 


STEP 6: Do an optimal design. The symmetric root locus of the system is as shown 
in Fig. 7.46. If we choose the closed-loop poles at 


a-(s) = (s + 0.0045)(s + 0.145)(s + 0.513)(s + 2.25 + j2.98), 
then the required feedback gain is 
K = [-0.0011 0.0016 —1.831 -—7.6113 -0.0011. 


Since w is proportional to angle of attack a, state feedback would require an angle- 
of-attack sensor. Such sensors are expensive and sometimes unreliable, hence an 
estimator would be required (see Chapter 6). The step response of the system to a 
100-ft step command in A is shown in Fig. 7.47, and the associated control effort 
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FIGURE 7.48 
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is shown in Fig. 7.48. This design has been done assuming that the linear model 
is valid for altitude changes under consideration. Simulations should be performed 
to verify this or determine the extent of the validity of the linear model. In order 
to achieve large altitude changes such as the one shown in Fig. 7.47, engine thrust 
may need to be increased. 


STEPS 7 AND 8: Verify the design. See Section 7.3.1. 


7.4 Control of the Fuel-Air Ratio in an Automotive Engine 


Up until the 1980s, most automobile engines had a carburetor to meter the fuel 
so that the ratio of the gasoline mass flow to air mass flow (F/A) remained in 
the vicinity of 1:15. This device metered the fuel by relying on a pressure drop 
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produced by the air flowing through a venturi. The device has performed adequately 
for the last 100 years in terms of keeping the engine running satisfactorily, but has 
historically allowed excursions of up to 20% in the F/A. After the implementation of 
exhaust-pollution regulations, these F/A excursions became unacceptable. During 
the 1970s, automobile companies improved the design and manufacturing process 
of the carburetors so that they became more accurate and delivered an accuracy 
in the vicinity of 3 to 5%. Through a combination of factors, this improved F/A 
accuracy helped lower exhaust-pollution levels. However, the carburetors were still 
open-loop devices in that no measurement was made of the F/A that entered the 
engine for subsequent feedback into the carburetor. 

During the 1980s, all manufacturers turned to feedback control systems to 
provide a much-improved level of F/A accuracy, an action made necessary by the 
decreasing levels of allowable exhaust pollutants. 

As for the other examples, we will discuss each step in the design of this 
system. 


STEP 1: Understand the process and its performance. The method chosen to meet 
the exhaust standards has been to use a catalytic converter that simultaneously ox- 
idizes excess levels of exhaust carbon monoxide (CO) and unburned hydrocarbons 
(HC) and reduces excess levels of the oxides of nitrogen (NO and NO»; or NO,). 
This device is usually referred to as a "three-way catalyst" because of its effect 
on all three pollutants. This catalyst is ineffective when the F/A is more than 1% 
different from the stoichiometric level of 1:14.7; therefore, a feedback control sys- 
tem is required to maintain the F/A within 196 of that desired level. The system is 
depicted in Fig. 7.49. The dynamic phenomena that affect the relation between the 
sensed F/A output from the exhaust and the fuel-metering command in the intake 
manifold are (1) intake fuel and air mixing, (2) cycle delays due to the piston 
strokes in the engine, and (3) the time required for the exhaust to travel from the 


FIGURE 7.49 
F/A feedback control system. 
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FIGURE 7.50 
Exhaust sensor output. 


engine to the sensor. All these effects are strongly dependent on the speed and load 
of the engine. For example, engine speeds will vary from 600 to 6000 rpm. The 
result of these variations is that the time delays in the system that will affect the 
feedback control system behavior will also vary by at least 10:1, depending on the 
operating condition. The system undergoes transients as the driver demands more 
or less power through changes in the accelerator pedal, with the changes taking 
place over fractions of a second. Ideally, the feedback control system should be 
able to keep up with these transients. 


STEP 2: Select a sensor. The discovery and development of the exhaust sensor was 
the key technological step that made this concept of exhaust-emission reduction 
possible. The device is made of zirconia; it is placed in the exhaust stream and 
yields a voltage related to the oxygen content of the gases. The F/A is uniquely 
related to the oxygen level. The voltage of the sensor is highly nonlinear with 
respect to F/A (Fig. 7.50), with almost all the change in voltage occurring precisely 
at the F/A where the feedback system must operate for effective performance of 
the catalyst. Therefore the gain of the sensor will be very high when the F/A is at 
the desired point (1:14.7), but will fall off considerably for F/A excursions away 
from 1:14.7. 

Although other sensors are under development for possible use in F/A feedback 
control, no other sensor has demonstrated the capability to perform adequately. All 
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manufacturers are currently using zirconia sensors in their feedback control systems 
in production automobiles. 


STEP 3: Select an actuator. Fuel metering can be accomplished by a carburetor or 
by fuel injection. To implement a feedback F/A system, the capability of adjusting 
the fuel metering electrically is required, since the sensor used provides an electric 
output. 

Carburetors have been designed to provide this capability by including ad- 
justable orifices that modify the primary fuel flow in response to the electric error 
signal. Most designs accomplish this by the use of on-off solenoid valves that 
modulate the pressure applied to a bellows in the carburetor. The bellows moves a 
needle to adjust the orifice size. The advantage of this approach appears to be that 
it is the cheapest of the alternatives. 

Since fuel-injection systems are typically electrical by nature, they can be 
used to perform the fuel adjustment for F/A feedback by simply including the 
capability of summing the feedback signal in the computer code. In some cases, 
fuel injectors are placed at the inlet to every cylinder (called multipoint injection), 
and in some cases there is one large injector upstream (called single-point or throttle 
body injection). With the growing popularity of microprocessor engine control, 
single-point fuel injection is becoming much more popular, apparently because its 
cost is approaching that of the carburetor. Differences in performance between 
the carburetor and single-point injection are not major, since they both introduce 
fuel at approximately the same location. Multipoint injection does offer improved 
performance because the fuel is introduced much closer to the engine, with better 
distribution to the cylinders. Being closer reduces the time delays and thus yields 
better engine response. Because of a significant cost penalty, however, multipoint 
injection is typically only used on relatively expensive, high-performance auto- 
mobiles. 


STEP 4: Make a linear model. The sensor nonlinearity shown in Fig. 7.50 is severe 
enough that design effort based on a linearized model of it should be used with 
caution. Figure 7.51 shows a block diagram of the system, with the sensor shown 
to have a gain K,. The two time constants indicated for the inlet manifold dynam- 
ics represent fast fuel flow in the form of vapor or droplets and slow fuel flow in 
the form of a liquid film on the manifold walls. The time delay is the sum of the 
delay caused by the four piston strokes from the intake process until the exhaust 
process and then the time required for the exhaust to travel from the engine itself 
to the sensor located perhaps | ft or so away. A sensor lag is also included in the 
process to account for the mixing that occurs in the exhaust manifold. Although 
the time constants and delay time change considerably, primarily as a function of 
engine load and speed, we will examine the design at a specific point where the 
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Inlet manifold 


FIGURE 7.51 
Block diagram of an F/A 
control system. 
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values are 
Tj = 0.02 s, 
Ty = l s, 
T 0.2 s, 
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STEP 5: Try a lead-lag or PID controller. Given the tight error specifications and 
the wide variations in the required fuel command uy due to varying engine- 
operating conditions, an integral control term is mandatory. Thus any required 
urf can be provided when the error signal e = 0. The addition of a proportional 
term, although not often used, allows for an increase (doubling) in the bandwidth 
without degrading steady-state characteristics. In this example, we will use a con- 
trol law that is proportional plus integral. The output from the control law is a 
voltage that drives the injector pulse-former to give a fuel pulse whose length is 
proportional to the voltage. The controller transfer function can be written as 


D,(s) = K, — = =2(s + z), (7.26) 


where 


and z can be chosen as desired. 

First, let's assume that the sensor is linear and can be represented by a gain K;. 
Then z can be chosen for good stability and good response of the system. Figure 
7.52 shows the frequency response of the system K;K, = 1.0 and z = 0.3, while 


FIGURE 7.52 
Frequency response of an F/A controller: (a) magnitude and (b) phase. 
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FIGURE 7.53 
Root locus of an F/A 
controller. 


Fig. 7.53 shows a root locus of the system versus K;K, with z = 0.3. Both 
analyses show that the system becomes unstable for K,K, = 2.8. Figure 7.52 
shows that to achieve a phase margin of approximately 60°, the gain K,K p should 
be = 2.2. The figure also shows that this produces a crossover frequency of 6.0 
rad/s (~ 1 Hz). The root locus in Fig. 7.53 verifies that this candidate design will 
achieve acceptable damping (¢ = 0.5). 

Although this linear analysis shows that acceptable stability at a reasonable 
bandwidth (~ 1 Hz) can be achieved with a PI controller, a look at the nonlinear 
sensor characteristics (Fig. 7.50) shows that this, indeed, may not be achievable. 
Note that the slope of the sensor output is extremely high near the desired setpoint, 
thus producing a very high value of Ks. Therefore lower values of the controller 
gain K, need to be used to maintain the overall K,K, of 2.2 when including the 
effect of the high sensor gain. On the other hand, a value of K , low enough to yield 
a stable system at F/A — 1:14.7 will yield sluggish response to transient errors that 
deviate much from the setpoint, because the effective sensor gain will be reduced 


FIGURE 7.54 
Sensor approximation. 
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substantially. It is therefore necessary to account for the sensor nonlinearity in order 
to obtain satisfactory response characteristics of the system for anything other than 
minute disturbances about the setpoint. A first approximation to the sensor is shown 
in Fig. 7.54. Since the sensor gain at the setpoint is still quite different between 
the actual sensor and its approximation, this approximation will yield erroneous 
conclusions regarding stability about the setpoint; however, it will be useful in a 
simulation to determine response to initial conditions. 


STEP 6: Try an optimal controller. The response of this system is dominated by 
the sensor nonlinearity, and any fine tuning of the control needs to account for that 
feature. Furthermore, the system dynamics are relatively simple, and it is unlikely 
that an optimal design approach will yield any improvement over the PI controller 
used. This step will therefore be omitted. 


STEP 7: Simulate design with nonlinearities. Figure 7.55(a) is a plot of the system 
error with the approximate sensor of Fig. 7.54 and K, K, = 2.0. The slow response 
is apparent with 12.5 s before the error comes out of saturation and a time constant 
of almost 5 s once the linear region is reached. In real automobiles, these systems 
are operated with much higher gains and to show these effects, a simulation with 
K,Ks = 6.0 is plotted in Fig. 7.55(b) and (c). At this gain, the linear system is un- 
stable and the signals initially grow, as may be seen in the figures for time before 5 s. 
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FIGURE 7.55 
System response with nonlinear sensor approximation. 
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The growth is halted by the fact that as the input to the sensor nonlinearity gets 
large, the effective gain of the sensor decreases due to the saturation, and, in the 
limit, a limit cycle is reached having a frequency corresponding to the point where 
the root locus crosses the imaginary axis and having an amplitude such that the 
total effective gain of K,Ks,eg = 2.8. As was described in Section 4.6.4, the 
effective gain of a saturation for moderately large inputs can be approximated by 
4N/7A where N is the saturation level and A is the amplitude of the input signal. 
Here, N = 0.4 and, if K, = 0.1, then we must have Ks,eq = 28. Thus we predict 
an input signal amplitude of A = (4)(0.4)/(7)(28) = 0.018. This value is closely 
verified by the plot of Fig. 7.55(c), the input to the nonlinearity in this case. The 
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frequency of oscillation is also nearly 10.1 rad/s, as predicted by the root locus in 
Fig. 7,53. 

In the actual implementation of feedback F/A controllers in automobile en- 
gines, sensor degradation over thousands of miles of use is of primary concern 
in order to meet the exhaust-pollution standards over the government-mandated 
50,000 mi. In order to reduce the sensitivity of the average setpoint to changes 
in the sensor output characteristics, manufacturers typically modify the design dis- 
cussed here. One approach is to feed the sensor output into relay function [Fig. 
4.26(b)], thus completely eliminating any dependency on the sensor gain at the 
setpoint. The frequency of the limit cycle is then solely determined by controller 
constants and engine characteristics. Average steady-state F/A accuracy is also 
improved. 


Control of a Digital Tape Transport 


STEP 1: Understand the process and its performance specifications. Most high- 
performance tape transports are designed with a small capstan to pull the tape 
past the read/write heads with the take-up reels turned by DC motors. The capstan 
motion is isolated from the reels by vacuum columns that provide constant tension 
to the tape at the heads. This structure permits separate design of capstan, vacuum, 
and reel controls. A sketch of the system is shown in Fig. 7.56, and a schematic 
of the capstan control is drawn in Fig. 7.57. The objective of the capstan-control 
system is to control the speed and the tension of the tape at the read/write head. 
The tape is to be controlled at speeds up to 200 in/s, with start-up as fast as 
possible subject to keeping the tension below 12 N at all times to prevent permanent 
distortion of the tape. 


STEP 2: Select a sensor. The sensor selection is easy in this case, being a DC 
tachometer to measure idler speed. Alternatives would be an AC generator, which 
would give a sinusoidal voltage signal whose amplitude is proportional to speed. 
This output voltage needs additional electronic signal processing such as rectifying 
and filtering to provide a suitable signal for the controller. Also possible is a digital 
shaft encoder that provides a digital reading of shaft position. Such devices have low 
inertia and low friction and are often used in digital control. Using digital control 
is increasingly attractive for motion-control problems; however, in the present case 
the need to convert the digital signal to analog form leads us to favor the DC 
tachometer. 


STEP 3: Select an actuator. There are many choices for motion-control actuators, 
including hydraulic, pneumatic, AC electric, DC electric, and stepping motors. 
Hydraulic and pneumatic actuators require an auxiliary pump but can provide high 
forces and torques in a lightweight package. They are common in aircraft control- 
surface servos and chemical-process valve controls. However, for our purpose the 


FIGURE 7.56 
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electric motors are the best choice, since they are reliable, inexpensive, and easy 
to maintain. Of these, the DC motor has the best low-speed acceleration and low- 
ripple-speed characteristics and is the machine of choice here. 


STEP 4: Make a linear model. The system is in static equilibrium when Tp = F 
and K mio = r;To. We define the variables as deviations from this equilibrium. 
The equations of motion of the system are given by the laws of mechanics: 


d 
nu + Bio, t riT = Kni, (7.27) 
X1 = Fri; (7.28) 
di 
Lr + Ri + Kq0, = e, (7.29) 
X2 = Fot02; (7.30) 
d 
Act + Bow2 = ProTn, (7.31) 
dt 
T = K\(x%3 — xi) + Di(¥3 — X1) (1-32) 
T; = K2(x2 — x3) + Do(X2 — X3), (7.33) 
KT = riĝi, (7.34) 
A. = r202, 39) 
— 
Nm RAIL E 5 m (7.36) 


where 


Jj = combined inertia of wheel, plus take-up motor,4 X 10? kg : m^, 
Bı = viscous friction at take-up wheel, 0.01 N: m: s, 
rı = wheel radius (take-up), 0.02m, 
Km = motor torque constant, 0.03V > s, 
Ja = inertia of idler, 10 ? kg - m?, 
B» = viscous friction at wheel, 0.01 N m:s, 
rj = radius of tape on idler, 0.02 m, 
D,5 = damping in tape-stretch motion, 20 N/m/s, 
Ki» = spring constant in tape-stretch motion, 4 X 10^ N/m, 
w; = speed of drive wheel, i, rad/s, 
w2 = output speed measured by tachometer output 05, rad/s 
T = tape tension, T? = T3 at read-write head, N, 
e — applied voltage, V, 
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R = armature resistance, 10, 
L = armature inductance, 10 ? H, 
0, = angular displacement of capstan, 
0; = tachometer shaft angle, 
F, = constant force (tape tension from vacuum column), 6 N, 
x3 = position of tape at head, m, 
X3 = velocity of tape at head, m/s. 
The equations of the system are fifth-order and are already of the form 
x = Fx + Gu, (7.37) 
y = Hx, (7.38) 
where 
x-[xi @ x? w i], 
u = e. 


There are two outputs of interest, tape position at the head (x3) and tape 
tension 7. For tape position, we have 


— wy or ks 
3 = a 
Thus for position at the head, 
H; = [0.5 0 0.5 O 0]. (7.39) 


The tension is given by Eq. (7.32), which we can write as 


$ + 
T = Ki #1 Z ai +m- o ah 
Kj Dj 
= 53 G2 — x1) + 7 (202 — r101). (7.40) 


If we substitute the numbers into these equations, we find very large and very 
small values, indicating the need for time and amplitude scaling. Ideally, we would 
like the elements in F, G, and H to be in the range 0.1 to 10, if possible. We write the 
equations in the state order with the numbers and use x ; and x; for the unscaled posi- 


tions: 
X; = 0.02, 
4 x 1070, = —400x, — 0.014c, + 400x, + 0.004w> + 0.03i, 
Xj = 0.0205, 
107705 = 400x; + 0.004, — 400x; — 0.014c5, 
tet = —0.03c, — i + e. (7.41) 
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After some experimentation, we decide to measure time in milliseconds, so 7 = 


-]0?r, and to measure position in units of 10? m, so we take x, = 10°x! and 
x2 = 10°x4. With these changes, the equations are 
in. 
da J eee 
dw 
ve fF —0.1x, — 0.35@, + 0.1x2 + 0.lw2 + 0.75i, 
dx? 
ae ae 
dt i 
do» 
—— = Q.4x, + 0.40, — 0.4x5 — 1.40», 
dT 
di 
0] 0 2 6 (7.42) 
dT 


These equations are described by the matrices: 


Qu, 2 0 ar. <0 0 
303*.35- 0.1 — 0.12. 0.75 0 

Bea 9 0 280. 1; WE 
04 04 -04 -14 0 0 
Oot 5Q 0 -1 l 


H = [0-0 T1 0-0] X2 output; 
H; —[0.5 0 0:5. 083 X3 Output; 
HE182 —0.2 02 02 "94 tension output. 


The transfer function to measure position x2 is 


eic ME 0.6(s + 2) 
E (s) $5 + 2.7554 + 3.2253 + 1.8852 + 0.4185 
0.6(s + 2) 


= M arn o o UB 7.43 
s(s + 0.507)(s + 0.968)(s + 0.637 + j0.667) cu 


STEP 5: Try a lead-lag or PID controller. The uncompensated root locus versus 
the proportional feedback gain and the open-loop frequency response of the system 
are shown in Figs. 7.58 and 7.59, respectively. It is desired to use feedback control 
to achieve a settling time of about 12 ms and a negligible overshoot in response 
to a maximum velocity command, defined as one causing no more than 6-N peak 
tension. 

The specifications call for an w, of about | rad/ms, and, with a pole-zero 
excess (that is, the difference between number of poles and zeros) of 4, we will 
require substantial lead. One way to design a compensator is to use derivative- 
(tachometer)-plus-lead-network feedback. If we place both the lead network zero 
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FIGURE 7.58 
Uncompensated root locus for a tape drive. 
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FIGURE 7.59 
Uncompensated frequency response for tape transport, K, = 1: (a) magnitude and (b) phase. 
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FIGURE 7.60 
Compensated root locus 
for a tape drive. 


and the zero due to the tachometer* at —0.968 and place the lead network pole at 
—9.68, then the compensator is 


(s + 0.968) 


PAn Erw 


(7.44) 


The root locus of the system is as shown in Fig. 7.60. The ramp response of the 
system is as shown in Fig. 7.61(a) and the associated tension is as shown in Fig. 
7.61(b). The frequency response of the compensated system is seen in Fig. 7.62. 


STEP 6: An optimal design using pole placement. We now consider designing a 
compensator using the state-variable approach. The symmetric root locus of the 
system is shown in Fig. 7.63. If we select the closed-loop poles of the system to 


* Pole-zero cancellation is usually avoided because of sensitivity problems but may be acceptable if the 
canceled pole is sufficiently stable. However, unstable pole-zero cancellation is absolutely forbidden. 


FIGURE 7.61 
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FIGURE 7.62 
Frequency response of 
compensated system: 
(a) magnitude and 

(b) phase. 
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FIGURE 7.63 
Symmetric root locus for tape drive. 
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FIGURE 7.64 
Step response for 
full-state feedback. 
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be on the SRL at a bandwidth of about 1 rad/ms, 


æc(s) = (s + 0.451 + j0.937)(s + 0.947 + j0.581)(s + 1.16), 


then the required state feedback gain is 
K = [0.802 2.58 0.489 0.964 1.21]. 


The step response of the system is shown in Fig. 7.64, where the reference input 
is multiplied by the inverse of the closed-loop DC gain; that is, 


u = —Kx + 1.29r, 


so as to obtain zero steady-state error to a unit step. The associated control effort 
is shown in Fig. 7.65(a) and the tension in Fig. 7.65(b). The ramp response of 
the system and the associated control effort are shown in Fig. 7.66(a) and (b), 
respectively. If measurement of all the states is not available and an estimator is 


to be designed based on position measurement alone, such that its poles are four 
times faster than the control, then 


ae(s) = (s + 1.80 € j3.75)(s + 3.79 + j2.32)(s + 4.64), 
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FIGURE 7.66 
(a) Ramp response with full-state feedback; (b) control effort for ramp command. 
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and the estimator gain is 


403.9 
50.6 
L=| 13.1 
38.6 
1166.2 


The compensator transfer function is then given by 


— 1905(s + 0.640 + j0.797)(s + 0.984 + j0.247) 
(s + 2.38)(s + 1.60 + j4.73)(s + 5.73 + j2.64) ’ 


with frequency response shown in Fig. 7.67, which is essentially a lead net- 
work. The frequency response of the complete compensated system is as shown in 
Fig. 7.68. 

The root locus of the compensated system is as shown in Fig. 7.69. Figure 


7.70 shows a transient response of the tension and position, including the effect of 
the estimator. 


D(s) = (7.45) 


STEPS 7 AND 8: Verify the design. At this point the system should be simulated 
with all nonlinearities included, followed by a prototype test. 
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FIGURE 7.67 
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FIGURE 7.68 
Frequency response of 
compensated system: 
(a) magnitude and 

(b) phase. 
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FIGURE 7.69 
Root locus for a 
compensated tape 
drive. 
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Summary 


In this chapter we have given an outline of control-system design intended to 
enlarge the perception of the factors involved in obtaining a satisfactory controller. 
After listing the steps in a possible design sequence, we have presented four case 
studies illustrating the method. In the first study we looked at the control of satellite 
attitude. The dynamic compensation involved a lightly damped resonance, and a 
notch filter was introduced as one design aid. We also saw that an SRL approach 
would automatically add a similar notch in this case. 

In the second case we looked at the control of a well-known commercial air- 
craft. In the yaw-damper case, we saw that a single feedback path produced a 
marginally acceptable result. Refining the design using the state-space SRL ap- 
proach improved damping from ¢ = 0.3 to 0.4 but increased the order of the 
compensator from 1 to 6. In the altitude-hold case, we saw that a classical mul- 
tiloop closure approach was difficult to design because of the high interaction 
between the loops, necessitating many design iterations. The SRL approach helped 
considerably in this process. 

In the third case, a control for fuel/air ratio in the automobile was studied. 
Here we needed to control with a pure time delay and a highly nonlinear sensor. 
In practice, this system is left to oscillate constantly in a limit cycle because of the 
vast range of conditions under which it must perform well. The final case involved 
a tape drive, characteristic of motion control. The main features here were that 
more than one lead network is required and more than one output (velocity and 
tension) needs to be monitored. 

In all these cases it became clear that the model used for design does not 
completely describe the true system to be controlled. In order to illustrate one of 
the analytical tools developed for this situation, an example of stability robustness 
determination has been included. 

We leave this chapter with the observation that practical control designs re- 
quire substantial calculations. The tools we have prescribed —the root locus and 
the Bode frequency response — can be used with great effectiveness for small prob- 
lems; however, the state-space method of pole placement and the calculation of 
time responses, especially for nonlinear systems, require the aid of a computer. 
Fortunately, the development of computer aids is progressing rapidly, and we be- 
lieve that every control engineer should have access to a CAD system. The curves 
developed in this chapter were primarily computed using CTRL-C, a product of 
Systems Control Technology, Inc. 


Problems 7.1 of the three types of PID control, which one is the most effective in reducing the 
error resulting from a constant disturbance? Explain. 


7.2 Is there a greater change of instability when the sensor in a feedback control system 
is not collocated with the actuator? Explain. 


FIGURE 7.71 


FIGURE 7.72 
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7.3 Consider the plant G(s) = 1/s?. What is the effect of adding a lead compensator, 


sta 


DA = OTD 


a « b, 


on the phase margin of this system? 
7.4 Consider the closed-loop system shown in Fig. 7.71, 


a) What is the phase margin if K — 70, 000? 

b) What is the gain margin if K — 70, 000? 

c) What value of K will yield a phase margin of ~ 70°? 

d) What value of K will yield a phase margin of ~ 0°? 

e) Sketch a root locus of the system, being careful of the locus location at s = jw 
and determine from your locus what value of K lies on the stability boundary. 

f) If the disturbance d is a constant and K — 10, 000, what is the maximum allowable 
value of d if Y is to remain less than 0.1? (Assume r = 0.) 

g) If it is required to allow larger values of d than the value you obtained in (f), but 
with the same error constraint, discuss what steps you could take to alleviate the 
problem. 


d(s) 


K(s+1) 
s+100 


7.5 Consider the system shown in Fig. 7.72, which represents an attitude-rate control for 
an aircraft. 


a) Design a compensator so that the dominant poles are at —2 + j2. 

b) Sketch the Bode plot of your design and select compensation so that the crossover 
is at least 2 Jd rad/s and PM = 50°. 

c) Sketch the root-locus of your design, finding w, > 2 ut and d = 0.5. 


2s+0.1 
52.0.1544 


Compensator Hydraulic 


servo 


Rate gyro 


7.6 Consider the system in Fig. 7.73. Which of the following claims are true? Explain in 
detail. 
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FIGURE 7.73 


Disturbance (0.1 Nm) 


Amplifier Actuator Load 
—1000 1000 O(rad/s) 
— Ts ee o> 
s+1000 s(s?--2s--25) | 
| 
Tachometer 


a) The actuator natural behavior (the pole at 1000 rad/s) must be included in an 
analysis to evaluate a usable maximum gain for which the control system is stable. 


b) The value of K must be negative for a stable system. 


c) For a certain value of K the control system will oscillate at a frequency within 1 


rad/s of 5 rad/s. 
d) The system is unstable if K < —10, that is, if | K |> 10. 


e) If K must be negative for stability, the control system cannot counteract a positive 


disturbance. 


f) A positive constant disturbance will speed up the load, thereby making the final 


value of e negative. 


g) With only a positive constant command input r, e must have a final value greater 


than zero. 


h) For K = ~—1 the loop is stable and for the disturbance shown there will be an 
error in speed, the magnitude of which in the steady state is less than 5 rad/s. 


7.7 The stick balancer is shown in Fig. 7.74. 


a) Using root-locus techniques, design a compensation that will place the dominant 


roots ats = —5 + j5 (that is, o, = 7 rad/s, £ = 0.707). 


b) Use Bode techniques to design a compensation to meet the following specifications: 
Oss < 0.001 for T; = 1, a constant, 


Phase margin = 50°, 
Closed — loop bandwidth = 7 rad/s. 


FIGURE 7.74 6 
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7.8 Consider the system in Fig. 7.75. 
a) Suppose G(s) = 2500K/[s(s + 25)]. 


1) Design a lead compensator so that the phase margin of the system is more than 
45°; the steady-state error due to a ramp should be less than or equal to 0.01. 

2) Design a lead compensator so that the overshoot is less than 25% and the 
settling time is less than 0.1 s (assume 1%). 


b) K 
G(s) = <4 0.1s\(1 + 025) 


and the performance specifications are K, = 100, with a phase margin = 40°. 


1) Is the lead compensation effective for this system? Find a lag compensator for 
the given specifications and plot the root locus of the compensated system. 
2) Design a lag compensator such that the peak overshoot is less than 20% and 
K, = 100. 
c) 1) Repeat [b(1)] using a lead-lag compensator. 
2) Find the root-locus of the compensated system and compare the findings with 
those of [b(1)]. 


FIGURE 7.75 


7.9 Consider the open-loop system 


10 


GG) = S GAO)” 


a) Sketch a Bode plot for this system. The design specifications are, for low frequency, 
K, = 100 and PM = 45°. Sinusoidal inputs of up to | rad/s should be reproduced 
with = 2% error. For high frequency, sinusoidal inputs greater than 100 rad/s 
should be attenuated at the output to = 5% of their input value. The block diagram 
sketched in Fig. 7.76 may be useful for conceptual purposes. 

b) First pick the open-loop gain K so that K, = 100. 


FIGURE 7.76 


c) Show that a sufficient condition for meeting the specifications on the sinusoidal 
inputs is that the magnitude plot lie outside the shaded regions in Fig. 7.77. Recall 
0/01, = KG/(1 + KG) and e/0, = 1/1 + KG. 


578 Chapter 7 / Control-System Design: Principles and Case Studies 


FIGURE 7.77 


d) Explain why introducing a lead network alone cannot meet the design specifica- 
tions. 

e) Explain why a lag network alone cannot meet the design specifications. 

f) Develop a full design using a lead-lag compensator that meets all the design speci- 
fications. Remember, you are not allowed to. alter the previously chosen open-loop 
gain. 


7.10 Consider the system in Fig. 7.78, where 


FIGURE 7.78 


7.11 


300 


G(s) = 4$ * 0.225yG + 4G + 180)" 


It is desired to have an overall system satisfying the following specifications: (1) The 
steady-state error due to a step function is zero; (2) the phase margin is 55? and the 
gain margin is at least 6 dB; and (3) the gain crossover frequency is not smaller than 
that of the uncompensated plant. 


a) What kind of compensation should be used and why? 
b) Design a suitable compensator D.,(s) to meet the specifications. 


We have discussed three design methods: the root-locus method of Evans, the 
frequency-response method of Bode, and the state-variable-pole-placement method. 
Explain which of these methods is best described by the following statements. If you 
feel more than one method fits a given statement equally well, say so and explain 
why. 


a) This method is readily used when the plant description must be obtained from 
experimental data. 


7.12 
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b) This method permits most direct control over dynamic response characteristics such 
as rise time, percent overshoot, and settling time. 

c) This method is most easily reduced to a computer-design algorithm. 

d) This method permits most direct control over the steady-state error constants of 
Kp or Ky. 

e) This method is most likely to lead to the /east-complex controller capable of meet- 
ing the dynamic and static accuracy specifications. 

f) This method allows the design to guarantee that the final design will be uncondi- 
tionally stable. 

g) This method can be used without modification for plants that include transportation 
lag terms such as 


—2s 


Gs) = Gia 


In design by the method of Bode we used lead and lag networks. For a type I system 
indicate the effects of these compensation networks on each of the design perfor- 
mance specifications listed below. Indicate the effects as “an increase,” “substantially 
unchanged," or “a decrease” and use the second-order plant G(s) = K/[s(s + 1)] to 
illustrate your conclusions. 


a) K, 

b) Phase margin 

€) Closed-loop bandwidth 
d) Percent overshoot 

e) Settling time 


7.13 Altitude control of a hot-air balloon. The equations of vertical motion of a hot-air 


balloon (Fig. 7.79) linearized about vertical equilibrium are 


st + lar = ôq, 
T| 


mZ+z= aôT + w, 


ôT = deviation of hot-air temperature from temperature that gives buoyant force 
altitude of balloon, 


ôq = deviation in burner heating rate from equilibrium rate, divided by thermal 
capacity of hot air, 


N 
Il 


w = vertical wind velocity. 
An altitude-hold autopilot is to be designed for a balloon whose parameters are 
T = 250 s, T, = 25s, a = 0.3m/s — (°C). 
Only altitude is sensed, so the control law is of the form 
dq(s) = D(s)[za(s) — z(s)], 


where z, is the desired (commanded) altitude. 
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FIGURE 7.79 


Balloon 


Ground | 


a) 


Sketch a root locus of the closed-loop eigenvalues versus gain K for a proportional- 
feedback controller, 6g = —K(z — za). Use Routh's criterion (or s = jw) to 
determine the value of gain above which the closed-loop system is unstable and 


. the associated frequency at neutral stability. 


b) 


c) 


e) 


f) 


Intuitively and from findings in (a), it is apparent that quite a bit of lead com- 
pensation is required to produce a satisfactory autopilot. Sketch a root locus 
of the closed-loop eigenvalues versus gain K for a double-lead compensator, 
ôq = —D(s)(z — za), where 

s DUST 

P K|; xd 

Sketch Bode straight-line asymptote plots of magnitude only for the open-loop 
transfer functions of the proportional-feedback and the lead-compensated systems. 
Select a gain K for the lead-compensated system to give a crossover frequency of 
0.06 rad/s. 
With the gains selected in (d), what is the steady-state error in altitude for a steady 
vertical wind of | m/s? (Be careful: first find the closed-loop transfer function from 
w to error.) 
If the error in (e) is too large, how would you modify the compensation to give 
higher low-frequency gain? (Give a qualitative answer only.) 


7.14 A satellite attitude control uses a reaction wheel to provide angular motion of the 
vehicle according to the equations: 


T* 4 T^, 
Ó — aZ, 
=D(s)Z, 


Satellite: 7 ó 
Measurement: Z 
Control: 7^ 
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T° = control torque, 
T** = external torque, 
ġ = angle to be controlled, 
Z = measurement from the sensor, 
I = satellite inertia, 1000 kg/m?, 
a = sensor constant, 1 rad/s, 
D(s) = compensation. 


a) Suppose D(s) = Ko, a constant. Draw the root locus with respect to K of the 
resulting closed-loop system. 

b) For what range of Ko is the resulting system stable? 

c) Add a lead network with pole at s = —1 so that the closed-loop system has a 
natural frequency of w, = 0.04 rad/s and a damping ratio of ¢ = 0.5. 


S+Z 


D = K ; 
(s) DET 


1) Where is the zero of the lead network ? 
2) Draw the root locus of the compensated system and give the design value 
of K fie 

d) For what range of K, is the system stable? 

e) What is the steady-state error to a constant 7 with this design? 

f) What is the “type” of this system with respect to rejection of T *'? 

g) Draw the Bode plot asymptotes of the open-loop system, with gain adjusted for 
the closed-loop value K, of (c). Use a scale of 1 in. per decade for magnitude and 
frequency and 1 in. per 90? for phase. Add the compensation of (c) and compute 
the phase margin of the result. 

h) Select as the state ^, @, and Z and write the state equations of the system. Select 
gains of Kg and K, to locate the control poles at s = —0.02 + 70.02 3. 


7.15 A standard control problem is sketched in Fig. 7.80, with three alternative solutions. 
The signal w is the plant noise and may be analyzed as if it were a step; the signal v is 
the sensor noise and may be analyzed as if it contained power to very high frequencies. 


a) Compute the values of the parameters Kj, a, K2, Kr, K3,d, and Kp so that 


Y(s) |. 16 
R(s) s? -- 4s + 16 


in each case. Note that in system III a pole is to be placed at s — —4. 
b) Complete the following table: 
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Express the last entries as A/s* to show how fast noise from v is attenuated at high 
frequencies. 
c) Rank the three designs as to 


Tracking 
Plant noise 


Sensor noise 


Rejection 


FIGURE 7.80 
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Problems 583 


The equations of motion for a cart-stick balancer are 
0 1 0 0 
x=] 31.33 0 0.016 |x+] —0.649 | u, 
-31:33 0  —0.216 8.649 


y=[10 0 O)x. 


a) Compute the transfer function and determine the poles and zeros. 

b) Determine the feedback gain K to move the poles of the system at third-order ITAE 
locations with w, = 4 rad/s. 

c) Determine the estimator gain L needed to place the estimator error poles at 
«ID. — 10, 10. 

d) Determine the compensator for the design in (b) and (c). Draw a root locus of the 
system. 

e) Suppose we use a reduced-order estimator with poles at —10, —10. What is the 
required estimator gain? 

f) Determine the compensator for the reduced-order estimator. Draw a root locus of 
the system. 

g) Compute the frequency responses of the two compensators. 


The lateral-directional perturbation equations for a Boeing 747 on landing approach 
in horizontal flight at sea level, with U = 221 ft/s (Mach 0.198) weight of 564,000 
lb are 


B —0.0890 0.989 0.1478 0.1441][ 8 0.0148 
t| | 0.168 —0.217 -—0.166 0 r 4 —.151 5p 
p| | -133 0327 -0.975 0 p 0.0636 | ' 
fo) 0 0.149 1 0 (0) 0 
B 
«ro 1-0 n0] 
r p 
$ 
The transfer function is 
R(s) —0.151(s + 105)(s + 0.0328 + j0.414) 


GG) = SRG) ^ (5 * 1.109) + 0.0425)(s + 0.646 = j0.731) 


Draw the uncompensated root locus and frequency response of the system. What would 
be a satisfactory classical controller? Try a state-variable design approach by drawing 
a symmetric root locus for the system. Choose the closed-loop poles of the system on 
the symmetric root locus at 


ac(s) = (s + 1.12)(s + 0.165)(s + 0.162 + 70.681), 
and choose the estimator poles to be five times faster at 


a,(s) = (s + 5.58)(s + 0.825)(s + 0.812 + 73.40). 
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7.18 


FIGURE 7.81 
Ball balancer design example. 


Compute the compensator transfer function. Discuss the properties of the robustness 
of the system with respect to parameter variations and unmodeled dynamics. Note the 
similarity to the design with the flight conditions discussed in this chapter. What does 
this suggest about providing a continuous (nonlinear) control throughout the operating 
envelope? 


Design and construct a device to keep a ball centered on a freely swinging beam. An 
example of such a device is shown in Fig.7.81. It uses coils surrounding permanent 
magnets as the actuator to move the beam, solar cells to sense the ball position, and 
a hall-effect device to sense the beam position. You should research other possible 
actuators and sensors as part of your design effort. Compare the quality of the control 
achievable for ball feedback only versus multiple loop feedback of both ball and beam 
position. 


8.1 


[| 


Digital 


Control 


Introduction 


The intent of this chapter is to provide the basic tools for the design of a control 
system that is to be implemented using a computer or microprocessor. The design 
methods are applicable to any type of computer (from microprocessor to large- 
scale computer); however, the effects of small word size and slow sample rates 
take on a more important role when a microprocessor is used. For a more complete 
discussion of this subject, see Franklin, Powell, and Workman (1990). 

A typical topology of the type of system to be considered is shown in Fig. 
8.1. There are two different approaches for the design of digital algorithms. 


1. Continuous design and digitization. Perform a continuous design, then digitize 
the resulting compensation. 

2. Direct digital design. Digitize the plant model, then perform a design using 
discrete analysis methods. 


Both methods will be covered and their advantages and disadvantages discussed. 
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FIGURE 8.1 


Basic control-system 


block diagram. 


8.2 


r(kT) 


Digital 
computer 
(CPU) 


D/A Controlled 
and Hold system 


Analog 
prefilter 


r=reference or command input 

y=output quantities 

u=actuator input signals 
A/D=analog-to-digital converter 
D/A=digital-to-analog converter 


An actual design process is often a combination of the two methods. A first 
iteration to a digital design can be obtained using a discretization of a continuous 
design. Then the result is tuned up using a direct digital analysis and design. 
No matter what the process used, a prudent designer typically follows up with a 
simulation of the digitally controlled system, including all sampling and calculation 
delays, to validate the system performance predicted by linear analysis. 


Theoretical Background 


8.2.1 z Transform 


In the analysis of continuous systems, we use the Laplace transform, which is 
defined by 


oc 


IA f(t)} = F(s) = | f (De " dt, (8.1) 


which leads directly to the important property that 
L{ f(t} = sF(s). (8.2) 


This relation enables us to easily find the transfer function of a linear continuous 
system, given the differential equation of that system. 


FIGURE 8.2 

A continuous and 
sampled version 
of signal f. 
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f(t) 


f(nT) 
f(t) 
T 
“eS 
0 T 2T 3T : 


For discrete systems, a very similar procedure is available. The z transform is 
defined by 


Z{ f(n} = F(z) = > f(x", (8.3) 
n=0 


where f (n) is the sampled version, as shown in Fig. 8.2, and n = 1, 2, 3, ... refers 
to discrete sample times f, t2, t3, . ... This leads directly to a property analogous 
to Eq. (8.2), namely, that 


Z(fn-D)-z'F() (8.4) 


where n — | refers to the value f(n) one sample cycle in the past. This relation 
allows us to easily find the transfer function of a discrete system, given the dif- 
ference equations of that system. For example, the general second-order difference 
equation, 
y(n) = —ayy(n — 1) — azy(n — 2) + bou(n) + biu(n — 1) + bou(n — 2), 
(8.5) 


can be converted to the z transform of y(n), u(n), and so on by invoking Eq. (8.4) 
once or twice to arrive at 


Y(z) = (-aiz |! — az 2)Y (z) + (bo + biz |  boz ^)U(), (8.6) 
which results in the transfer function 


Y(z  bo-tbiz bz 


= 8.7 
U(z) l + ajz lasz? ix 


8.2.2 z Transform Inversion 


Table 8.1 relates simple discrete time functions to their z transforms and gives the 
Laplace transforms for the same time functions. 
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Given a general z transform, one can expand it into a sum of elementary terms 
using partial fraction expansion and find the resulting time series from the table. 
Again, these procedures are exactly the same as those used for continuous systems. 

A z transform inversion technique that has no continuous counterpart is called 
long division. Given a z transform 

N (z) 

Y(z) D(z)" (8.8) 
one simply divides the denominator into the numerator using long division. The 
result is a polynomial (perhaps infinite) in z, from which the time series can be 
found by using Eq. (8.3). 

For example, a first-order system described by the difference equation 


y(n) = ky(n — 1) + u(n) (8.9) 
yields 
F2) — l 
U(z l—-kz M 


For an impulsive input defined by 
u(0) — 1, 
u(n) = 0 n $T 0, 
the z transform is 
U(z) = 1 


and 


Y(z) = l (8.11) 


| 
—kz7! ` 
Therefore, to find the time series, we use long division as follows: 


1+ kz + k?z? + Pg. 


l—kz')1 


l—kz7! 
kz~'+0 
kz-!— k?z? 
k?z? +0 
kz?z ?— k3z73 


k3z73 


to yield the infinite series for Y (z): 
Y(z) = 1+ kz! + k?z? + kz 3 tee, 
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which means that (see Eq. 8.3) the sampled time history of y is 


y(0) = 1, 
y(1) =k, 
yQ) =-k?, 
y(n) = k”. 


8.2.3 Relationship between s and z 


For continuous systems, we saw in Chapter 2 that certain behavior results from 
different pole locations in the s plane: oscillatory behavior for poles near the imag- 
inary axis, exponential decay for poles on the negative real axis, and unstable 
behavior for poles with a positive real part. The same kind of association is also 
useful to designers for discrete systems. Consider the continuous signal 


f= e” t>0, (8.12) 


which has the Laplace transform 


F(s) = "wy (8.13) 
and corresponds to a pole at s — —a. The z transform of f (nT) is 
F(z) = Z{e~2""}, 
which can be seen from Table 8.1 to be 
FQ) = a (8.14) 
which corresponds to a pole at z = e ^^. This means that a pole at s = —a in 


the s plane corresponds to a pole at z = e ^7 in the discrete domain. This is true 
in general, and the equivalent characteristics in the z plane are related to those in 
the s plane by the expression 


z - ei (8.15) 


where T is the sample period. Table 8.1 also includes the Laplace transforms, 
demonstrating the z = e?7 relationship in the denominators of the table entries. 

Figure 8.3 shows the mapping of lines of constant damping ¢ and natural 
frequency w, from the s plane to the upper half of the z plane, using Eq. (8.15). 
The mapping has several important features: 


1. The stability boundary is the unit circle |z| — 1. 


2. The small vicinity around z = +1 is essentially identical to the vicinity around 
s=0. 
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3. The z plane locations give response information normalized to the sample rate, 
rather than to time, as in the s plane. 


4. The negative real z axis always represents a frequency of w,/2, where w, = 
27/T = sample rate. 


5. Vertical lines in the left-half s plane (constant real part or time constant) map 
into circles within the unit circle of the z plane. 


6. Horizontal lines in the s plane (constant imaginary part or frequency) map into 
radial lines in the z plane. 


7. There is no location in the z plane that represents frequencies greater than 
w,;/2. Physically, this is because one must sample at least twice as fast as a 
signal’s frequency to represent it digitally. Mathematically, it is because of the 
nature of the trigonometric functions imbedded in Eq. (8.15). 


8.2.4 Final-Value Theorem 


The final-value theorem for continuous systems discussed in Section 2.7.1, 
lim x(t) = lim sX(s), (8.16) 
to 96 ‘= 
is often used to find steady-state system errors or steady-state gains of portions of 
a control system. The analog for discrete systems is obtained by noting that a con- 


tinuous steady response is denoted by X(s) = A/s and leads to the multiplication 
by s in Eq. (8.16). Therefore, since the steady response for discrete systems is 


Xe) = ——, 
2) l= 23 


the discrete final-value theorem is 
lim x(n) = lim(1 —z bX(). (8.17) 
no 2 

For example, to find the DC gain of the transfer function 


_ X(z) _ 0.58(1 +z) 
Tag) ge He 


let u(n) = 1 for n = 0, so that 


U(z) = 


=g 
and 


0.58(1 + z) 


TO 7 q-: 6016) 
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8.3 


FIGURE 8.4 
A continuous control 
system. 


Applying the final-value theorem yields 


0.58(1 + z) 


z +0.16 " 


x(9) = lim 


z1 


and therefore the DC gain of G(z) is unity. In general, we see that to find the DC 
gain of any stable transfer function (all poles within the unit circle), we simply 
substitute z = 1 and compute the resulting gain. 

Since the gain of a system should not change whether represented continuously 
or discretely, this calculation is an excellent aid in finding a discrete controller that 
best matches a continuous controller. It is also a good check on the calculations 
associated with determining the discrete model of a system. 


Continuous Design 


The first part of this design procedure should already be familiar to the reader, 
since it has been the subject of the first seven chapters of the book. We carry out 
this part of the design as before, with no changes required to represent the fact 
that the control will eventually be implemented digitally. The second part of the 
procedure is to digitize the resulting compensation. 


8.3.1 Digitization Procedures 


The problem is: Given a continuous compensation D(s), find the best equivalent 
discrete compensation D(z). Or more exactly, given a D(s) from the control system 
shown in Fig. 8.4, find the best digital implementation of that compensation. A 
digital implementation requires that y be sampled at some sample rate and that the 
computer output samples be smoothed in some manner so as to provide a continuous 
u. For ease of hardware design, the smoothing operation is almost always a simple 
hold (or zero-order hold, ZOH), which is shown in Fig. 8.5. 

Therefore we can restate the problem as: Find the best D(z) in the digital 
implementation shown in Fig. 8.6 to match a desired D(s). It is important to note 
at the outset that there is no exact solution to this problem because D(s) responds 
to the complete time history of x(t), whereas D(z) has access only to the samples 


FIGURE 8.5 
Zero-order hold. 


FIGURE 8.6 
Digital compensation 
implementation. 
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u(t) 
u(n) 


x(n). In a sense, the various digitization approximations simply make different 
assumptions about what happens to x(t) between the sample points. 


Tustin’s Method 


One digitization method is to approach the problem as one of numerical integration. 
Suppose 


that is, pure integration. Therefore 


mT —-T T 


x(t) dt «| x(t) dt, 
ni =f 


u(nT) = | 


0 


which can be rewritten as 
u(nT) = u(nT — T) + area under x(t) over last T, (8.18) 


where T is the sample period. u(nT) is usually written u(n) for short, and the 
task at each step is to use trapezoidal integration, that is, to approximate x(t) by 
a straight line between the two samples (Fig. 8.7). Therefore Eq. (8.18) becomes 


u(nT) = u(nT — T) + ST = Tier att); (8.19) 


or, taking the z transform, 


{ie nes l 


å if aaa (8.20) 
X(z) 21-z-  Q/DUQ-z-y- z-) 


For 


xum x(n) | De | u(n) | zon | u(t) 
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FIGURE 8.7 
Trapezoidal integration. 


x(t) 


nT-T nT 


application of the same integration approximation yields 


a 
D FS, 
(z) Q/TY)(1 -z711 +z] +a 
In fact, the substitution 
| ales" 
= T1+z7! 


(8.21) 


in any D(s) yields a D(z) based on the trapezoidal integration formula. This is 
called Tustin’s, or the bilinear approximation. 


Matched Pole-Zero Method (MPZ) 

Another digitization method, called the matched pole-zero, is found by extrapo- 
lation of the relation between the s and z planes stated in Eq. (8.15). If we take 
the z transform of a sampled x(t), then the poles of X(z) are related to the poles 
of X(s) according to z = e^. The idea of the matched pole-zero technique is to 
apply z = e?? to the poles and zeros of a transfer function, even though it doesn't 
strictly apply to transfer functions or even to the zeros of a time sequence. Like all 
the transfer function digitization methods, this method is an approximation; here 
the approximation is motivated partly by the fact that z = e57 is the correct s-to-z 
transformation for the poles of a time sequence and partly by the minimal amount 
of algebra required to determine the digitized transfer function. 

Since physical systems often have more poles than zeros, it is also useful to 
arbitrarily add zeros to D(z) at z = —1—that is, a (1 + z !) term— which causes 
an averaging of the current and past input values, as in the trapezoidal integration 
(Tustin's) method. The gain is selected so that the low-frequency gains of D(s) and 
D(z) match one another. The method can be summarized as follows: 


1. Map poles and zeros according to z = e'f. 


2. Add 1 -z !, (1 z Y, or the like if the numerator is of a lower order than 
the denominator. 


3. Match DC or low-frequency gain. 
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For example, the matched pole-zero approximation of 


sta 
D(s) = 
(s) stb 
is 
Z e aT 
D(z) — rs or (8.22) 
where 
i = al i - mu 
bl-—e-4Tr 
and for 
$ 3-4 (z + D(z—e' T) 
D(s) = —— È D(z) = k————————, 
(s) s(s + b) PN) (e= Di =g) ned 
where matching gain at low frequency yields 
i at] - e T 
|». 2b1- eco! 


In both digitization methods, the fact that an equal power of z appears in the 
numerator and denominator of D(z) implies that the difference equation output at 
time n will require a sample of the input at time n. For example, the D(z) in Eq. 
(8.22) can be written 


Ue) _. . yl - ar 
Xz) ^ D(z) = k-— Bi 


where a = e ^" and B = e "*, which by inspection can be seen to result in the 
difference equation 


u(n) = Bu(n — 1) * k[x(n) — ax(n — 1)]. (8.24) 


It is impossible to sample x(n), compute u(n), and then output u(n) all in 
zero elapsed time; therefore Eq. (8.24) is technically impossible to implement. 
However, if the equation is simple enough or the computer is fast enough, a slight 
delay between the x(n) sample and the u(n) output will have a negligible effect 
on the actual response of the system compared with that expected from the original 
design. A rule of thumb would be to keep the delay on the order of one-twentieth 
of the system rise time. 


Modified Matched Pole-Zero Method (MMPZ) 

The D(z) in Eq. (8.23) would also result in u(n) being dependent on x(n), the 
input at the same time point. If the structure of the computer hardware prohibits 
this relation or if the computations are particularly lengthy, it may be desirable to 
derive a D(z) that has one less power of z in the numerator than in the denominator, 
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so that the computer output u(n) would only require input from the previous time, 
that is, x(n — 1). To do this, we simply modify step 2 in the matched pole-zero 
procedure. The second example, 


8 Td 
D = š 
(s) s(s + b) 
would then become 
—aT 
£g 
D = k ———————— , 
uc he ei) 
where 
k = sine 
bl-—e-T 


which results in 
u(n) = (1 + e ")u(n — 1) e" u(n —2) + k[x(n — 1) - e x(n — 2)]. 


In this equation an entire sample period is available to perform the calculation 
and to output u(n). A discrete analysis of this controller would therefore more ac- 
curately explain the behavior of the actual system. However, because the controller 
is using data that is one cycle old, this controller will typically not perform as well 
as the MPZ in terms of the deviations of the desired system output. 


Method Comparison 

A numerical comparison of the magnitude of the frequency response for a first- 
order compensator is made in Fig. 8.8 for the three approximation techniques at 
two different sample rates. The results of the D(z) computations used to draw Fig. 
8.8 are shown in Table 8.2. 


FIGURE 8.8 
A comparison of discrete approximations. 


ws=15 Hz=100 rad/s ws=3 Hz-20 rad/s 


TABLE 8.2 
Digital Approximations: 
D(z) for D(s) = 5/(s +5) 


FIGURE 8.9 
A continuous-design 
statement. 
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Method €, = 15Hz w, = 3Hz 
Matched pole-zero (MPZ) 0.143 F - Lus 0.405 z = à i 89 
Modified MPZ (MMPZ) 0.285 — TT uais ig 
Tustin's 0.143- £ m ini - WU 


The figure shows that all the approximations are quite good at frequencies 
below about one-fourth the sample rate, w,/4. If w,/4 is sufficiently larger than 
the filter break frequency —that is, if the sampling is fast enough —the break char- 
acteristics are accurately reproduced. Tustin's and the MPZ methods show a notch 
at w,/2 because of their zero term, z + 1. Other than the large difference at w,/2, 
which is typically outside the range of interest, the three methods have similar 
accuracies. Since the MPZ techniques require much simpler algebra than Tustin's, 
they are preferred if the designer is performing the calculations by hand. 


8.3.2 Design Example 


For a 1/s? plant, we wish to design a digital controller to have a closed-loop natural 
frequency w, - 0.3 rad/s and ¢ = 0.7. The first step is to find the proper D(s) 
defined in Fig. 8.9. The specifications can be met with 


ta 


S 
= 8.25 
D(s) K- LI ( ) 
where 
a = 0.2, 
b = 2.0, 
k = 0.81, 


as can be verified by the root locus in Fig. 8.10. To digitize this D(s), we first 
need to select a sample rate. For a system with w, = 0.3 rad/s, a very “safe” 
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FIGURE 8.10 
s plane locus versus k. 


-—9 Re(s) 


Selected roots 
(k=0.81) 


sample rate would be a factor of 20 faster than w,, yielding 
w, = 0.3 xX 20 = 6 rad/s, or 1 Hz. 


Thus let's pick 7 = 1 s. The matched pole-zero digitization of Eq. (8.25) is given 
by Eq. (8.22) and yields 


z = 0.82 
D = 0.389 —— à 
(z) i =H Dis (8.26) 
or 
0.389 — 0.319z ^! 
lE pee ANAL c RN 
(z) ]—0.135z7! ' 
Computer Plant 


FIGURE 8.11 
A digital control system. r(n) 


Sampler (T=1 s) 
and 

analog-to- digital 

conversion 


8.4 
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which leads to 
u(n) = 0.135u(n — 1) + 0.389e(n) — 0.319e(n — 1), (8.27) 
where 
e(n) = r(n) — y(n), 


and completes the digital algorithm design. The complete digital system is shown 
in Fig. 8.11. 


8.3.3 Applicability Limits of Method 


If an exact discrete analysis or a simulation of a system were performed and the 
digitization determined for a wide range of rates, the system would be unstable 
for sample rates slower than approximately 5 X w,, and the damping would be 
substantially degraded for sample rates slower than 10 X «,. At sample rates on 
the order of 20 X w, (or 20 X bandwidth for more complex systems), this design 
method will yield reasonable results, and can be used with confidence for sample 
rates of 30 X bandwidth or higher. 

Basically, the errors come about because the technique ignores the lagging 
effect of the ZOH. An approximate method to account for this is to assume that 
the transfer function of the ZOH is 


2/T 


Gzou(s) = 


This is based on the idea that, on the average, the hold delays the signal by 
T/2, and the above is a first-order lag with a time constant of 7/2 and a DC 
gain of 1. We could therefore patch up the original D(s) design by inserting this 
Gzon(S) into the original plant model and finding the D(s) that yields satisfactory 
response. 

One of the advantages of using the continuous design method, however, is 
that the sample rate need not be selected until after the basic feedback design is 
completed. Use of Eq. (8.28) eliminates this advantage, although it does partially 
alleviate a primary disadvantage, the approximate nature of the method. 


Discrete Design 


8.4.1 Analysis Tools 


The first step in performing a control design or analysis of a system with some 
discrete elements is to find the discrete transfer function of the continuous portion. 
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FIGURE 8.12 

(a) Mixed control system; 
(b) pure discrete 
equivalent. 


For a system similar to that shown in Fig. 8.1, we wish to find the transfer function 
between u(kT) and y(kT). Unlike the case discussed in the previous section, there 
is an exact discrete equivalent for this system because the ZOH precisely describes 
what happens between samples, and the output y(n) is dependent only on the input 
at the sample times u(n). 

For a plant described by a G(s) and preceded by a ZOH, the discrete transfer 
function is 


G(z) = (1 -anz | SO}, (8.29) 


S 


where Z{F(s)} is the z transform of the time series whose Laplace transform is 
F(s), that is, on the same line in Table 8.1. The formula has the term G(s)/s 
because the control comes in as a step input during each sample period. The term 
1 — z`! is there because a one-sample duration step can be thought of as an infinite 
duration step followed by a negative step one cycle delayed. This formula (Eq. 
8.29) allows us to replace the mixed (continuous and discrete) system shown in 
Fig. 8.12(a) with a pure discrete equivalent system shown in Fig. 8.12(b). 

The analysis and design of discrete systems is very similar to the analysis and 
design of continuous systems; in fact, all the same rules apply. The closed-loop 
transfer function of Fig. 8.12(b) is obtained using the same rules of block-diagram 
reduction; that is, 


Y@) _ _DG 


(8.30) 


Rz) 1+DG’ 


(a) 


(b) 
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Since we'd like to find the characteristic behavior of the closed-loop system, we 
wish to find the factors of the denominator of Eq. (8.30), that is, find the roots of 
the characteristic equation 


1 + D(z)G(z) = 0. (8.31) 


The root-locus techniques used in continuous systems to find roots of a polynomial 
in s apply equally well here for the polynomial in z. The rules apply directly 
without modification; however, the interpretation of the results is quite different, 
as we saw in Fig. 8.3. A major difference is that the stability boundary is now the 
unit circle instead of the imaginary axis. 

A simple example of the discrete design tools discussed so far should help fix 
ideas. Suppose G(s) in Fig. 8.12(a) is 


G(s) = ps (8.32) 
It follows from Eq. (8.29) that 
= T oe Z EN INS 
GG) eor y s +a) 
i j= ary. 4l 
-(1-z n ran 
=r 4b. 
A l—@ 
ea 
where 
a=e 


To analyze the performance of a closed-loop proportional control law, that is, 
D(z) = k, we use standard root-locus rules. The result is shown in Fig. 8.13(a), 
and for comparison the root locus for a continuous controller is shown in Fig. 
8.13(b). In contrast to the continuous case, which remains stable for all values 
of k, the discrete case becomes oscillatory with a decreasing damping ratio as z 
goes from 0 to —1 and eventually becomes unstable. This instability is due to 
the lagging effect of the ZOH, which is properly accounted for in the discrete 
analysis. 
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FIGURE 8.13 
(a) z plane root locus; 
(b) s plane root locus. 


(a) 


(b) 
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8.4.2 Feedback Properties 


In continuous systems we typically start the design process by using proportional, 
derivative, or integral control laws or combinations of these, sometimes with a 
lag included. The same ideas are used in discrete designs directly, or perhaps the 
D(z) that results from the digitization of a continuously designed D(s) is used as 
a starting point. 

The discrete control laws are 


Proportional: 

u(n) = kpe(n) > D(z) = kp; (8.33) 
Derivative: 

u(n) = kp[e(n) — e(n — 1)], 


which has the z transform 


_ E 
D(z) = kp(1 — z^!) = kp —; (8.34) 
Integral: 
u(n) = u(n — 1) + k;e(n), 
which has the z transform 
k k 
D(z) = — = —“. (8.35) 
lcg mm y 


8.4.3 Design Example 


For an example, let's use the same problem that we used for the continuous design: 
the 1/s? plant. Using Eq. (8.29), we have 


T? z +1 
= — 8.36 
G(z It- ( ) 
which becomes, with T = 1 s, 
l z+1 
a = 8.37) 
G(z) 2G y ( 


Proportional feedback in the continuous case yields pure oscillatory motion, and 
in the discrete case we should expect even worse results. The root locus in Fig. 
8.14 verifies this. For very low values of k (very low frequencies compared to 
the sample rate) the locus is tangent to the unit circle (£ = 0 and pure oscillatory 
motion), thus matching the behaviour of the proportional continuous design. For 
higher values of k, the locus diverges into the unstable region because of the effect 
of the ZOH and sampling. 
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FIGURE 8.14 
z plane for a 1/s? plant. 


FIGURE 8.15 
Compensated z plane 
locus for the 1/s? 
example. 


Im(z) 


Re(z) 


To compensate for this, let’s add a velocity term to the control law, or 
u(z) = k[1 + y(1 — z le(z), (8.38) 
which yields 


D(z) = k(1 + y)< 


CM (8.39) 


Now the task is to find the values of y and k that yigld good performance. When 
we did this design previously, we wanted w, = 0.3 rad/s and ¢ = 0.7. Figure 8.3 
indicates that this s plane root location maps into a z plane location of 


z = 0.8 +0.2j. 


Desired 
roots 
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Figure 8.15 shows that for y = 4 and k = 0.08, or 


— 0.8 
D(z) = 0.4* ee (8.40) 


the roots are at the desired location. Normally, it is not particularly advantageous 
to match specific z plane root locations; rather it is only necessary to pick k and y 
to obtain acceptable z plane roots, a much easier task. In this example, we want to 
match a specific location only so that we can compare the result with the previous 
design. 

The control law that results is 


u(z) = 0.08[1 + 4(1— z !)] 
Or 
u(n) = 0.4e(n) — 0.32e(n — 1), (8.41) 


which is very similar to the control law equation (8.27) obtained previously. 


8.4.4 Design Comparison 


The controller designed using purely discrete methods, Eq. (8.41), basically dif- 
fers from the continuously designed controller, Eq. (8.27), only by the absence 
of the u(n — 1) term. The u(n — 1) term in Eq. (8.27) results from the lag 
term, (s + b), in the compensation, Eq. (8.25), which is typically included in 
analog controllers for noise attenuation and because of the difficulty in building 
pure analog differentiators. Some equivalent lag in discrete design naturally ap- 
pears as a pole at z = O (see Fig. 8.15) and represents the one sample delay 
in computing the derivative by a first difference. For more noise attenuation, the 
pole could be moved to the right of z = O, thus resulting in less derivative 
action and more smoothing, the same trade-off that exists in continuous control 
design. 

Other than the u(n — 1) term, the two controllers represented by Eqs. (8.27) 
and (8.41) are very similar. This similarity results because the sample rate is fairly 
fast compared with w,; that is, ws = 20 X w,. As the sample rate decreases, 
the numerical values in the compensations become increasingly different. For the 
discrete design, the actual system response follows that indicated by the z plane 
root locations, while the continuously designed system response diverges from that 
indicated by the s plane root locations. 

As a general rule, discrete design should be used if sampling frequency is 
slower than 10 X w,. At the very least, a continuous design with slow sampling 
(ws < 10w,) should be verified by a discrete analysis or simulation, and the 
compensation adjusted if necessary. A simulation of a digital control system is 
a good idea in any case. If the simulation properly accounts for all delays and 
possibly asynchronous behavior of different modules, it may expose instabilities 
that are impossible to detect using continuous or discrete linear analysis. 
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8.5 


State-Space Design Methods 
We have seen in Chapter 6 that a linear, constant-coefficient continuous system can 
be represented by a set of first-order matrix differential equations: 

x = Fx + Gu + Giw, (8.42) 


where u is the control input to the system and w is a disturbance input. The output 
equation can be expressed as 


y = Hx + Ju, (8.43) 
and the solution to the state equation is 
t 
x(t) = eF'—')x(t9) «| e"? Gu(r) dt. (8.44) 
to 


It is possible to use this solution to obtain a discrete state-space representation of the 
system. We wish to use this solution over one sample period to obtain a difference 
equation; hence we juggle the notation a bit (let t = nT + T and tọ = nT) and 
arrive at a particular version of Eq. (8.44): 


nT+T 
x(nT +T) = ef x(nT) «| eg" T* T^ Gw(z) dr. (8.45) 
nT 


This result is not dependent on the type of hold, since u is specified in terms of 
its continuous time history u(7) over the sample interval. A common and typically 
valid assumption is that of a zero-order hold (ZOH) with no delay, that is, 


u(T) = u(nT), nT T «nl +T. 
To facilitate the solution of Eq. (8.45) for a ZOH with no delay, let 
n=nT+T-r. 


Then we have 
T 
x(nT + T) = eF"x(nT) + | eFn dyn Gu(nT). (8.46) 
0 


If we define 
® = e! (8.47) 


and 


T 
r - | ef dnG, (8.48) 
0 
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Eqs. (8.42) and (8.43) reduce to difference equations in standard form: 
x(n + 1) = ®x(n) + Tu(n) + l'iw(n), 
y(n) = Hx(n) + Ju(n), (8.49) 


where we include the effect of a disturbance w. If w is a constant, then I’; is given 
by Eq. (8.48), with G replaced by G;. If w is an impulse, then T; = G; and 
w(n) = woóo(n).* The ® series expansion, 


® = ef? =1+FT+ = - rr foes, 
can also be written 
$ =I1+FTW, (8.50) 
where 
Ww=I+ 5r + =: Te 


The I" integral in Eq. (8.48) can be evaluated term by term to give 


k=0 
= FTU 
ag (E + 1} 
= WTG (8.51) 
We evaluate W by a series in the form 
FT FT FT FT 
= I+ — į I+ — | e m I+ IM, 8.52 
pei 2 3 SER zu | Á ) 


which has better numerical properties than the direct series of powers. We then find 
[ from Eq. (8.51) and ® from Eq. (8.50). For a discussion of various methods 
of numerical determination of and I’, refer to Franklin, Powell, and Workman 
(1990) and Moler and van Loan (1978). 

To compare this method of representing the plant with the discrete transfer 
function, we can take the z transform of Eq. (8.49), with w = J = 0, and obtain 


[zI - ®)X(z) = l'U(z), (8.53) 
Y(z) = HX(z). (8.54) 


* 6o is the discrete, or Kronecker, delta, which is zero except at n = 0, where it is 1.0. 
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Therefore 


Y (z) = 

—— = H[z1- 9] T. 8.55) 

U(z) | | i 
For the satellite attitude control example discussed in Section 2.2, the ® and T 
matrices are easy to calculate using Eqs. (8.50) and (8.51) and the following values 
for F and G: 


0 1l 


0 
0 0 l 


F = | 


| e- 


Since F? = 0 in this case, ® has only two nonzero terms, 


® =1+FT 


elt de 


r 


-E sles d] 


Hence, using Eq. (8.55), we obtain 


Y) - 10] [1 T]] [7?2 
Uc) | oe 1 f | Ea 
cT aki 
| 2-1)? 


which is the same result that would have been obtained using the z transform tables. 
Note that to compute Y/U we find that the denominator is the determinant det[z I — 
o], which comes from the matrix inverse in Eq. (8.55). This determinant is the 
characteristic polynomial of the transfer function, and the zeros of the determinant 
are the poles of the plant. We have two poles at z = 1 in this case, corresponding 
to two integrations in this plant's equations of motion. 

We can further explore the question of poles and zeros and the state-space 
description by considering again the transform formulas, Eqs. (8.53) and (8.54). An 
interpretation of transfer-function poles from the perspective of the corresponding 
difference equation is that a pole is a value of z such that the equation has a 
nontrivial solution when the forcing input is zero. From Eq. (8.53), this implies 
that the linear equations 


[zI — $]X(z) = [0] 


have a nontrivial solution. From matrix algebra the well-known requirement for 
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this is that det[zI — ®] = 0. In the present case, 


= on z i Ls 
det[zI 9] = dei Ü x E Jl 
= as SE Bias 
= det 0 ven 
- (z—-1?)2-290, 


which is the characteristic equation, as we have seen. 

Along the same line of reasoning, a system zero is a value of z such that 
the system output is zero even with a nonzero state and input combination. Thus 
we are able to find a nontrivial solution for X(zo) and U(zo) such that if Y (zo) 
is identically zero, then zo is a zero of the system. Combining Eqs. (8.53) and 
(8.54), we must satisfy the requirement 


zi-@® -ID||X(z) 
u(z) 

Once more the condition for the existence of nontrivial solutions is that the deter- 
minant of the square coefficient system matrix be zero. For the satellite example, 


z-1 -T -T?n 


H 0 = [0]. (8.56) 


- _72 
det} 0 z=] "-—Ff | = Get it is 
1 0 0 j 
T? 
= T? + —(z - 1) 
7 -T° 
"ibd 
T? 
= —(z+1 
5 Zt 
Thus we have a single zero at z = —1, as we have seen from the transfer function. 


Much of the algebra for state-space control design is the same as for the 
continuous time case discussed in Chapter 6. The poles of a discrete system can 
be moved to desirable locations by linear state-variable feedback: 


u = —Kx (8.57) 
such that 
det[zI — ® + IK] = a,(z), (8.58) 


provided the system is controllable. The system is controllable if the controllability 
matrix 


€-[T 6r Tr oT) (8.59) 


is full-rank. 
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8.6 


A discrete full-order estimator has the form 
R(n + 1) = R + Fu(n) + L[y(n) — H&(n)], (8.60) 

where & is the state estimate. The error equation 
K(n + 1) = (® — LH)&(n) (8.61) 


can be given arbitrary dynamics a,(z), provided that the system is observable, 
which requires that the observability matrix 


H 
Ho 


0=| He (8.62) 


Ho" ^! 


be full-rank. 
Similar to the continuous time case, if the open-loop transfer function is 


Y 
(z) _ b) (8.63) 
U(z) a(z) 
then a state-space compensator can be designed such that 


R(z  @æe(z)æe(z) 


where r is the reference input. The polynomial a,(z) is selected by the designer 
and results in a control gain K so that det[zI — ® + TK] = a,(z) using exactly the 
same methods that were discussed in Chapter 6 for continuous systems. Similarly, 
the polynomial a@,(z) is selected by the designer and results in an estimator gain L, 
so that det[zI -® + LH] = a,(z). If the estimator is structured according to Fig. 
6.44(a), the system zeros y(z) will be identical to the estimator poles a,(z), thus 
removing the estimator response from the closed-loop system response. However, 
if desired, the polynomial y(z) can be selected arbitrarily by the designer with 
suitable feedforward of the reference input. The reader is referred to Franklin, 
Powell, and Workman (1990) for details. 


Hardware Characteristics 


8.6.1 Analog-to-Digital (A/D) Converters 


A/D converters are devices that convert a voltage level from a sensor to a digital 
word usable by the computer. At the most basic level, all digital words are binary 
numbers consisting of many bits that are set either to 1 or 0. Therefore the task of 
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the A/D at each sample time is to convert a voltage level to the correct bit pattern 
and often to hold that pattern until the next sample time. 

Of the many A/D conversion techniques that exist, the most common are based 
on counting schemes or successive approximation schemes. In counting methods, 
the input voltage may be converted to a train of pulses whose frequency is propor- 
tional to the voltage level. The pulses are then counted over a fixed period using 
a binary counter, thus resulting in a binary representation of the voltage level. A 
variation on this scheme is to start the count simultaneously with a linear (in time) 
voltage and to stop the count when the voltage reaches the magnitude of the input 
voltage to be converted. 

The successive approximation technique tends to be much faster than the count- 
ing methods. It is based on successively comparing the input voltage to reference 
levels representing the various bits in the digital word. The input voltage is first 
compared with a reference that is half the maximum. If the input voltage is greater, 
the most significant bit is set, and the signal is then compared with a reference that 
is % the maximum to determine the next bit, and so on. These converters require 
one clock cycle to set each bit, so they would need n cycles for an n-bit converter. 
At the same clock rate, a counter-based converter might require as many as 2” 
cycles, which would usually be much slower. 

For either technique, it will take longer to perform the conversion for a higher 
number of bits. Not surprisingly, the price of A/Ds goes up with both speed and 
bit size. For example, an eight-bit (resolution of 0.4%) A/D with the minimal 
performance capability of a 100 us conversion time sold for a modest $3 in 1990, 
whereas faster models with a 50 ns conversion time sold for approximately $40. 

If more than one channel of data needs to be sampled and converted to digital 
words, it is usually accomplished by use of a multiplexer rather than by multi- 
ple A/Ds. The multiplexer sequentially connects the A/D into the channel being 
sampled. 


8.6.2 Digital-to-Analog (D/A) Converters 


D/A converters are used to convert the digital words from the computer to a voltage 
level for driving actuators or perhaps a recording device such as an oscilloscope or 
stripchart recorder. The basic idea is that the binary bits are used to cause switches 
(electronic gates) to open or close, thus routing the electric current through an ap- 
propriate network of resistors so that the correct voltage level is generated. Since no 
counting or iteration is required for D/As, they tend to be much faster than A/D con- 
verters. In fact, a D/A is a component in an A/D based on successive approximation. 


8.6.3 Analog Prefilters 


This device is often placed between the sensor and the A/D. Its function is to 
reduce the higher-frequency noise components in the analog signal so as to prevent 
the noise from being switched to a lower frequency by the sampling process (called 
aliasing or folding). 
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FIGURE 8.16 


An example of aliasing. 
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An example of aliasing is shown in Fig. 8.16, where a 60-Hz oscillatory signal 
is being sampled at 50 Hz. The figure shows the result from the samples as a 10- 
Hz signal and also shows the mechanism by which the frequency of the signal is 
aliased from 60 to 10 Hz. Aliasing will occur any time the sample rate is not at 
least twice as fast as any of the frequencies in the signal being sampled. Therefore, 
to prevent aliasing of a 60-Hz signal, the sample rate would have to be faster than 
120 Hz, clearly much higher than the 50-Hz rate in the figure. 

This phenomenon is one of the consequences of the sampling theorem of 
Nyquist and Shannon, which basically states that, for the signal to be accurately 
reconstructed from the samples, it must have no frequency component greater than 
half the sample rate (w,/2). Another consequence is that the highest frequency that 
can be represented by discrete samples is w,/2, an idea that has been discussed in 
Section 8.2.3. 

The consequence of aliasing on a digital control system can be substantial. 
In a continuous system, noise components with a frequency much higher than the 
control-system bandwidth normally have a small effect because the system won't 
respond at the high frequency. However, in a digital system the frequency of the 
noise can potentially be aliased down in frequency to the vicinity of the system 
bandwidth; therefore, the system will respond, thus causing the noise to appear on 
the system's output. 
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The solution is to place an analog prefilter before the sampler. In many cases 
a simple first-order low-pass filter will do; that is, 


a 


DLL UAE sta’ 

where the breakpoint a is selected lower than w,/2 so that any noise present with 
frequencies greater than w,/2 is attenuated by the prefilter. The lower the breakpoint 
frequency selected, the more the noise above w,/2 is attenuated. However, too low 
a breakpoint may reduce the control system’s bandwidth. The prefilter does not 
eliminate the aliasing; but by judicious choice of the prefilter breakpoint and the 
sample rate, the designer has the ability to reduce the magnitude of the aliased 
noise to some acceptable level. 


8.6.4 The Computer 


This is the unit that does all the computations. Most computers used today for 
control are built around an integrated circuit called a microprocessor that contains 
most of the functions needed. It could be housed in a desktop-size workstation or 
PC, or possibly in a shoebox-size dedicated microcomputer. The relatively low cost 
of microprocessor technology is making its use very attractive and has accounted 
for the large increase in the use of digital control systems that has occurred in the 
1980s. The computer consists of a central processor unit, or CPU, which does the 
computations and provides the system logic, a clock to synchronize the system, 
memory modules for data and instruction storage, and a power supply to provide 
the various required voltages. The memory modules come in three basic varieties: 


1. ROM (read-only memory) is the least expensive, but, once manufactured, 
its contents cannot be changed. Typically most of the memory in products 
manufactured in quantity is ROM. 

2. RAM (random-access memory) is the most expensive, but its values can be 
changed by the CPU. It is required to store only the values that will be changed 
during the control process and typically represents only a small fraction of the 
total memory of a developed product. 

3. PROM (programmable read-only memory) is a ROM whose values can be 
changed by a technician using a special device. It is typically used during 
product development to enable the designer to try different algorithms and 
parameter values. 


Microprocessors for control applications generally come with a digital word 
size of either 8, 16, or 32 bits, although some have been available with 12 bits. 
Larger word sizes give better accuracy, but at an increase in cost. The most eco- 
nomical solution is often to use an 8-bit microprocessor, but to use two digital 
words to store one value (double precision) in the areas of the controller that are 
critical to the system accuracy. 
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Word-Size Effects 


A numerical value can be represented with only limited precision in a digital 
computer. For fixed-point arithmetic, the resolution is 0.4% of full range for 8 bits 
and 0.1% for 10 bits; resolution drops by a factor of 2 for each additional bit. The 
effect of this quantization shows up in A/D conversion, multiplication truncation, 
and parameter storage errors. If the computer uses floating-point arithmetic, the 
resolution of the multiplication and parameter storage changes with the magnitude 
of the number being stored, the resolution affecting only the mantissa, while the 
exponent essentially continually adjusts the full scale. 


8.7.1 Random Effects 


As long as a system has varying inputs or disturbances, A/D errors and multipli- 
cation errors act in a random manner on the system and essentially produce noise 
at the output of the system. The output noise due to a particular noise source (A/D 
or multiplication) has a mean value of 


Ao = Apchy, (8.65) 
where 


Hpc = DC gain of transfer function between noise source and output, 


iy mean value of noise source. 


The mean value of the noise will be zero for a round-off process but has a value 


where q is the resolution level for a truncation process. Although most A/Ds round 
off, producing no mean error, some truncate and do produce an error. The total 
noise effect is the sum of all noise sources. 

The variance of the output noise a, is always nonzero, irrespective of whether 
the process truncates or rounds. The value of the output variance is most easily 
found by solving the discrete Lyapunov equation 


R, = ®R,®' + IT'o, (8.66) 
where 
c? = HR.H'!, 
70, = output noise rms, 
R, = state covariance matrix, 
7; = input noise variance, 


o, H = system description matrices from Section 8.5, 
I = noise input matrix. 


FIGURE 8.17 
Parallel implementation. 
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The input noise variance has magnitude 


for either round-off or truncation. 

The evaluation of Eq. (8.66) is usually done using computer tools as described 
in Franklin, Powell, and Workman (1990). Carrying out the calculations for a 
system with a small-word-size computer (8 bits or less) will generally show that 
the noise response of the system becomes more sensitive as the sampling rate 
increases and can be a design issue for very fast sample rates. However, for 16- or 
32-bit computers, the onset of significant noise errors occurs at such a high sample 
rate that quantization noise is not a factor in design. 

The sensitivity of a system to A/D errors can be partly alleviated by adding 
lag in the digital controller or by adding more bits to the A/D converter. Different 
structures of the digital controller have no effect. 

On the other hand, multiplication errors can be reduced substantially for high- 
order (greater than second-order) controllers by proper structuring of a given control 
transfer function. For example, a second-order transfer function with real roots, 


U(z) . £ —D& 


D(z) = nimmer vn 8.68 
€) 7 E() ^ (x - 0.2) - 0.3) ve 

can be implemented in a direct manner, yielding 
u(n) = 0.5u(n — 1) — 0.06u(n — 2) + e(n) — 0.8e(n — 1), (8.69) 


or can be implemented in a parallel manner that results from a partial fraction 
expansion of Eq. (8.68). The result, shown in Fig. 8.17, yields 

x1(n) = 0.2x,(n — 1) + 6e(n), 

x2(n) = 0.3x2(n — 1) + 5e(n), 

u(n) = x\(n) — x(n). (8.70) 


Note that the transfer functions to the output from the multiplications in Eq. 
(8.69) are substantially different from those in Eq. (8.70). It is also possible to 
implement the D(z) with a cascade factorization, which would be two first-order 
blocks arranged serially for this example. 
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Either cascade or parallel implementations would be preferred to the direct 
implementation for digital controllers with a small word size because of their 
substantially reduced response to quantization errors. 


8.7.2 Systematic Effects 


Parameters such as the numerical values in Eqs. (8.69) and (8.70), if in error, will 
change the dynamic behavior of a system. In a high-order controller with a small 
word size and a direct implementation, a very small percentage error in a stored 
parameter can result in substantial root-location changes and can sometimes cause 
instability. In the Apollo command module, a 14-bit word size for parameter storage 
would have resulted in instability if a direct implementation had been used in the 
sixth-order compensator! These effects are amplified when there are two compen- 
sator poles close together (or repeated) or when there are fast sample rates, when 
all poles tend to clump around z = +1 and are close to one another. These effects 
can be reduced by using larger word sizes, parallel or cascade implementations, 
double-precision parameter storage, and slower sample rates. 

Under conditions of constant disturbances and input commands, multiplication 
errors can also cause systematic errors. Typically the result is a steady-state error or 
possibly a limit cycle. The steady-state error results from the deadband that exists 
in any digital controller. The magnitude of the deadband is proportional to the DC 
gain from the multiplication error to the output and to the resolution level. Stable 
limit cycles occur only for controllers with lightly damped poles. These effects are 
also reduced by larger word sizes, parallel or cascade implementations, and slower 
sample rates. 


Sample-Rate Selection 


The selection of the best sample rate for a digital control system is the result of a 
compromise among many factors. The basic motivation to lower the sample rate 
€, is cost. A decrease in sample rate means more time is available for the control 
calculations; hence slower computers can be used for a given control function or 
more control capability can be achieved from a given computer. Either way, the 
cost per function is lowered. For systems with A/D converters, less demand on 
conversion speed will also lower cost. These economic arguments indicate that 
the best engineering choice is the slowest possible sample rate that still meets all 
performance specifications. 
Factors that could provide a lower limit to the acceptable sample rate are 


1. Tracking effectiveness, as measured by closed-loop bandwidth or by time- 
response requirements, such as rise time and settling time 
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2. Regulation effectiveness, as measured by the error response to random plant 
disturbances 


3. Resonances in the plant that require a sampling rate twice their natural fre- 
quency 


4. Sensitivity to plant-parameter variations 


5. Error due to measurement noise and the associated prefilter design methods. 


A fictitious limit on the sample rate occurs when using continuous-design tech- 
niques. The inherent approximation in the method may give rise to system instabil- 
ities as the sample rate is lowered, and this can lead the designer to conclude that 
a lower limit on ws has been reached when, in fact, the proper conclusion is that 
the approximations are invalid; the solution is not to sample faster but to refine the 
design with a direct digital-design method. 


8.8.1 Tracking Effectiveness 


An absolute lower bound to the sample rate is set by a specification to track a 
command input with a certain frequency (the system bandwidth). The sampling 
theorem states that in order to reconstruct an unknown, band-limited, continuous 
signal from samples of that signal, one must sample at least twice as fast as the 
highest frequency contained in the signal. Therefore, in order for a closed-loop 
system to track an input at a certain frequency, it must absolutely have a sample 
rate twice as fast as that frequency; as a result, w, must be about ten times the 
system bandwidth (v, > 10 X wgw). We also saw from the z plane mapping, 
z = e, that the highest frequency that can be represented by a discrete system 
is w,/2, supporting this conclusion. 

It is important to note the distinction between the closed-loop bandwidth «gw 
and the highest frequencies in the open-loop plant dynamics, since these two fre- 
quencies can be quite different. For example, closed-loop bandwidths could be 
an order of magnitude /ess than open-loop modes of resonances for some control 
problems. Information concerning the state of the plant resonances for purposes of 
control can be extracted from sampling the output without satisfying the sampling 
theorem because some a priori knowledge is available (even though imprecise) con- 
cerning these dynamics, and the system is not required to track these frequencies. 
Thus, a priori knowledge of the dynamic model of the plant can be included in the 
compensation in the form of a notch filter. 

The “closed-loop bandwidth" limitation provides the fundamental lower bound 
on the sample rate. In practice, however, the theoretical lower bound of sampling 
at twice the bandwidth of the reference input signal would not be judged suffi- 
cient in terms of the quality of the desired time responses. For a system with a 
rise time on the order of 1 s, thus yielding a closed-loop bandwidth on the order 
of 0.5 Hz, it is not unreasonable to insist on a sample rate of 5 to 20 Hz, which is a 
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factor of 10 to 40 times wgw. This is necessary in order to reduce the delay between 
a command and the system response to the command and to smooth the system 
output to the control steps coming out of the ZOH. In other words, most digital 
control systems have sample rates that are considerably faster than the lower limit 
imposed by the sampling theorem. 


8.8.2 Disturbance Rejection 


Disturbance rejection is an important aspect — if not the most important one —of any 
control system. Disturbances enter a system with various frequency characteristics 
ranging from steps to white noise. For the purpose of sample-rate selection, the 
higher-frequency random disturbances are the most influential. 

The ability of the control system to reject disturbances with a good continuous 
controller represents a lower bound on the error response that can be hoped for when 
implementing the controller digitally. In fact, some degradation over the continuous 
design must occur because the sampled values are slightly out of date at all times 
except at precisely the sampling instants. However, if the sample rate is very fast 
compared with the frequencies contained in the noisy disturbance, no appreciable 
loss should be expected from the digital system as compared with the continuous 
controller. At the other extreme, if the sample time is very long compared with 
the characteristic frequencies of the noise, the response of the system because of 
noise is essentially the same as the response if there were no control at all. The 
selection of a sample rate will place the response somewhere in between these 
two extremes, and thus the impact of the sample rate on the disturbance rejection 
of the system may be very influential to the designer in selecting the sample 
rate. 

Although the best choice of sample rate in terms of the wgw multiple is 
dependent on the frequency characteristics of the noise and the degree to which 
random disturbance rejection is important to the quality of the controller, sample 
rates on the order of 20 to 50 times wgw are typical. 


8.8.3 Plant Resonances 


In some cases, a plant may have open loop resonances that are considerably faster 
than the closed-loop bandwidth of the system. It is sometimes necessary to sample 
at least two times faster than these resonances. Systems where the resonance is 
very lightly damped and where the controller is adding damping to the resonant 
mode are particularly susceptible to this sensitivity. A determination of whether this 
limitation needs to be adhered to can be determined by performing a disturbance 
noise analysis using the Lyapunov equation as described for quantization noise 
in Eq. (8.66) or by simulating the digitally controlled system including random 
disturbance inputs. 
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8.8.4 Parameter Sensitivity 


Any control design relies to some extent on knowledge of the parameters represent- 
ing plant dynamics. Discrete systems exhibit an increasing sensitivity to parameter 
errors for a decreasing w, when the sample period becomes comparable to the pe- 
riod of any of the open-loop vehicle dynamics. For systems with all plant dynamics 
in the vicinity of the closed-loop bandwidth or slower, root-location changes due to 
parameter errors will not likely be a constraining factor unless the parameter error 
is quite large. However, for systems with a structural (or other) resonance stabilized 
by a notch filter, imperfect knowledge of the plant resonance characteristics will 
lead to changes in the system roots, and possibly to instabilities. This sensitivity 
to plant parameter increases as the sample rate decreases and could limit how slow 
the sample rate is in some cases. Typically, however, some other factor limits the 
sample rate, and at worst, some effort needs to be made in the controller design 
to minimize system sensitivity. 


8.8.5 Control-System Design Methodology 
Prefilter Design 


Digital control systems with analog sensors typically include an analog prefilter 
between the sensor and the sampler or an A/D converter as an antialiasing device. 
The prefilters are low-pass, and the simplest transfer function is 


H,(s) = 


8.71 
Sta ( 


so that the noise above the prefilter breakpoint a is attenuated. The design goal is 
to provide enough attenuation at half the sample rate (w,/2) so that the noise above 
w,/2, when aliased into lower frequencies by the sampler, will not be detrimental 
to the control-system performance. 

A conservative design procedure is to select the breakpoint and w, sufficiently 
higher than the system bandwidth so that the phase lag from the prefilter does 
not significantly alter the system stability, and thus the prefilter can be ignored in 
the basic control-system design. Furthermore, for a good reduction in the high- 
frequency noise at @,/2, the sample rate is selected about 5 or 10 times higher 
than the prefilter breakpoint. The implication of this prefilter design procedure is 
that sample rates need to be on the order of 30 to 100 times faster than the system 
bandwidth. If done this way, the prefilter design procedure is likely to provide the 
lower bound on the selection of the sample rate. 

An alternative design procedure is to allow significant phase lag from the 
prefilter at the system bandwidth and thus to require that the control design be 
carried out with the analog prefilter characteristics included. This procedure allows 
the designer to use very low sample rates, but at the expense of increased complex- 
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Problems 


ity in the original design, since the prefilter must be included in the plant transfer 
function. If this procedure is used and low prefilter breakpoints are allowed, the 
effect of sample rate on sensor noise is small and essentially places no limits on 
the sample rate. 


Asynchronous Modules 

As noted in the previous section, divorcing the prefilter design from the control-law 
design may result in the necessity for a faster sample rate than otherwise. This same 
result may exhibit itself for other types of modularization. For example, a smart 
sensor with its own computer running asynchronously from the primary control 
computer will not be amenable to direct digital design, because the overall system 
transfer function depends on the phasing between the smart sensor and the primary 
digital controller. This situation is similar to that of the digitization errors discussed 
in Section 8.3 and will therefore require sample rates on the order of 30 X wpw. 


Summary 


Most control systems today are implemented using a digital computer. This chap- 
ter has briefly described the steps that must be taken to transfer the compensations 
designed throughout the book into a form suitable for programming into a digi- 
tal computer. The effects of sample rate and computer word size have also been 
discussed. 


8.1 The z transform of a discrete time filter h(k) is 


1 + (1/2)z7! 


HG) = tI azx-un « ax. 


a) Let u(k) and y(k) be the discrete input and output of this filter. Find a difference 
equation relating u(k) and y(k). 

b) Find the natural frequency and damping of the filter's poles. 

€) Is the filter stable? 


8.2 Use the z transform to solve the difference equation 


y(k) — 3y(k — 1) + 2y(k — 2) = 2u(k — 1) — 2u(k — 2), 
uk) =k k=O 

0 k«0, 

yk)=0 k<0O. 


Problems 623 


8.3 The one-sided z transform is defined as 


a) 
b) 


F(z) = > fikáz. 
0 


Show that the one-sided transform of f(k + 1) is Z{f (k + 1)} = zF(z) — z f(0). 
Use the one-sided transform to solve for the transforms of the Fibonacci numbers 
generated by the difference equation u4.5 = Ug+ı + Uug. Let uo = u; = 1. Hint: 
You will need to compute the transform of f(k + 2). 


c) Compute the location of the poles of the transform of the Fibonacci numbers. 


d) 
e) 


8.4 a) 


b) 


8.5 a) 


b) 


Compute the inverse transform of the numbers. 
Show that if u, is the kth Fibonacci number, then the ratio u;..;/u; will go to 
(1 + J5)/2, the “golden ratio” of the Greeks. 


The following transfer function is a lead network designed to add about 60° lead 
ato; = 3 rad/s: 
yi 
H(s) = ————. 
07 Isl 


For each of the following design methods compute and plot in the z plane the pole 
and zero locations and compute the amount of phase lead given by the network at 
y = ge. Let T 0525s. 


1) Tustin's rule 
2) Pole-zero mapping 


Plot on log-log paper over the frequency range w = 0.1 — w = 100 rad/s the 
amplitude Bode plots of each of the above equivalents and compare with H(s). 
Hint: Amplitude Bode plots are given by 


IH (z)| = |H(e/*")| 


The following transfer function is a lag network designed to introduce gain atten- 
uation of a factor of 10 (20 dB) at w = 3: 
10s ++ 1 
H(s) = —————. 
(5) 7 3005 1 


For each of the following design methods compute and plot in the z plane the 
pole-zero pattern of the resulting discrete equivalent and give the gain attenuation 
atz; = ef, Le T = 0.254, 


1) Tustin’s rule 
2) Pole-zero mapping 


For each case computed, plot the Bode amplitude curves over the range v, = 
0.01 — w, = 10 rad/s. 


8.6 Consider the linear equation Ax = b, where A is an n X n matrix. One way of solving 
for x, given b, is by the following algorithm (a discrete-time system): 


x(k + 1) = (I + cA)x(k) — cb, 


where c is a scalar to be chosen. 
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a) Show that the solution of Ax = b is the equilibrium point x* of the discrete-time 
system. An equilibrium point x* of a discrete-time system x(k + 1) = f[x(k)] is 
given by x* = f(x"). 

b) Consider the error e(k) = x(k) — x*. Write the linear equation that relates the error 
e(k + 1) to e(k). 

c) Suppose |1 + cA;(A)| € 1, i = L,..., n. Show that starting from any initial guess 
Xo, the algorithm converges to x'. A;(A) denotes the ith eigenvalue of A. Hint: 
For any matrix B, A;(I + B) = 1 + A,(B). 


8.7 Consider the configuration for an autopilot, shown in Fig. 8.18, where 


40(s + 2) 


90) 7 G 1067-14) 


a) Find the transfer function G(z) for T — 1 assuming it is preceded by ZOH. 

b) Find the ranges of K such that the closed-loop system is stable. 

c) Draw the root locus. 

d) Compare the results in (b) to the case where an analog controller is used; that is, 
where the sampling switch is always closed. Which system has a bigger allow- 
able K? 


8.8 Write a computer program to compute ® and I from F, G, and sample period T. Use 
your program to compute ® and I if 


-1 0 1 
os-[; 3]. e-[] r-o2. 
-3 -2 1 
8.9 a) For 
jl T _ T?/2 
?-|, | r=| 


find a transform matrix T such that, if x = Tw, the equations in w will be in 
control canonical form. 

b) Compute K,,, the gain, such that, if u = —K,,w, the characteristic equation will 
be a.(z) = z? — 1.6z + 0.7. 

c) Use T from (a) to compute K,, the gain in the x states. 


8.10 Consider a control realization with transfer function 1/s? and piecewise constant input 
of the form 


u(t) = u(iN), il < t (i+ DA. 


FIGURE 8.18 


Satellite control 
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a) Show that if we restrict attention to the time instants iA,i = O, 1, 2,..., the 
resulting so-called sampled-data system can be described by the equations 


oe 0][ x1G) ls 
xxitl1)} [A 1|! x) A?/2 


yi) - [0 1][x;G) xa()]'. 


b) Design a second-order observer that will always reduce the error in an estimate of 
the initial state vector to zero in time 2A or less. 

c) Is it possible to estimate the initial state exactly with a first-order observer? Justify 
your answer. 


u(i), 


8.11 Single-axis satellite attitude control. Satellites often require attitude control for proper 
orientation of antennas and sensors with respect to the earth. Figure 2.5 shows a 
communication satellite with a three-axis attitude-control system. To gain insight 
into the three-axis problem, we often consider one axis at a time. Figure 8.19 depicts 
the case where motion is allowed only about an axis perpendicular to the page. The 
equations of motion of the system are given by 


10 = Mc T Mp, 


where / is the moment of inertia of the satellite about its mass center, Mc is the 
control torque applied by the thrustors, Mp is the sum of the disturbance torques, 
and Ó is the angle of the satellite axis with respect to an “inertial” reference. The 
inertial reference must have no angular acceleration. Normalizing, we define 


Mc m Mp 
u = —, = — 
I oo a 
and obtain 
0-2u- Wd. 


Inertial 
reference 


\/ 
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8.12 


8.13 


Taking the Laplace transform, 
1 
(s) = SGlu(s) + wa(s)], 


which becomes, with no disturbance, 


0(s) 1 

— = — = G(s). 

u(s) E i(s) 
In the discrete case with u being applied through a zero-order hold, we can use the 
methods of Chapter 8 to obtain the discrete transfer function 


02). T^ c t1 


Gi(z) = uz) = 2G » DU 


a) Sketch the root locus of this system with proportional feedback. What is the type 
of this system? 

b) Add a lead network to your locus so that the dominant poles are at ¢ = 0.5 and 
@, = 3m/lOT. 

c) What is the feedback gain if T = 1 s? If T = 2 s? 

d) Plot the closed-loop step response for T = 1 s. 


Compute ® by changing states so that the system matrix is diagonal. 


a) Compute e^^, where 
=] 0 
» | 0 M 


using the infinite series. 

b) Show that if F = T~'AT for some nonsingular transformation matrix T, then 
eT = Toe T. 

c) Show that if 


-3 1 
F = , 
-2 0 
there exists a T such that T~'AT = F. Hint: Write T~'A = FT™', assume four 
unknowns for the elements of T~!, and solve. For more general interest, write 
T^! as a matrix of columns and show that the columns are eigenvectors of F. 


d) Compute eF7. 


It is possible to suspend a mass of magnetic material by means of an electromagnet 
whose current is controlled by the position of the mass (Woodson and Melcher, 1968). 
A schematic of a possible setup is shown in Fig. 8.20, and a photo of a working 
system at Stanford University is shown in Fig. 2.27. The equations of motion are 


mx = -mg + f(x, D, 


where the force on the ball due to the electromagnet is given by f(x, D). At equi- 
librium the magnet force balances the gravity force. Suppose we call the current 


FIGURE 8.20 


Problems 627 


Ce 
EL 


there Ip. If we write I = Io + i, expand f about x = O and I = Io, and neglect 
higher-order terms, we obtain 


mł = k\x + kai. 


Reasonable values are m = 0.02 kg, kı = 20 N/m, and k2 = 0.4 N/A. 


a) Compute the transfer function from i to x and draw the (continuous) root locus 
for simple feedback i = —Kx. 

b) Let the sample period be 0.02 s and compute the plant discrete transfer function 
when used with a zero-order hold. 

c) Design a digital control for the magnetic levitation to meet the specifications 
t, = 0.1 s, t, =S 0.4 s, and percent overshoot = 20%. 

d) Plot a root locus of your design versus k, and discuss the possibility of balancing 
balls of various masses. 

e) Plot a step response of your design to an initial disturbance displacement on the 
ball and show both x and the control current i. If the sensor can measure x over 
a range of only +0.25 cm and the amplifier can provide a current of only 1 A, 
what is the maximum displacement possible for control, neglecting the nonlinear 
terms in f(x, D? 


8.14 In Problem 8.13 we described an experiment in magnetic levitation whose equation 


of motion reduced to 
X = 1000x + 20u. 


Let the sampling time be 0.01 s. 


a) Use the pole placement technique to design this system to meet the specifications 
that settling time be less than 0.25 s and the overshoot to an initial offset in x be 
less than 20%. 

b) Plot step responses of x, X, and u for an initial x displacement. 

c) Plot the root locus for changes in the plant gain, and mark the design pole loca- 
tions. 

d) Introduce a command reference with feed-forward so that the estimate of X is 
not forced by r. Measure or compute the frequency response from r to system 
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error r — x and give the highest frequency for which the error amplitude is less 
than 20% of the command amplitude. 


8.15 A servomechanism for antenna azimuth control. It is desired to control the elevation 
of an antenna designed to track a satellite (Fig. 8.21). The antenna and drive parts 
have a moment of inertia J and damping B, arising to some extent from bearing and 
aerodynamic friction, but mostly from the back emf of the DC-drive motor (Fig. 
8.22). The equations of motion are 


JÖ + Bô = T, + Tı, 


where T, is the net torque from the drive motor and 7; is the disturbance torque due 
to wind. If we define 


m e PM 
Fh B' EE 
the equations reduce to 
1 : 
—0 +0 = u +wa 
a 
Transformed, they are 
0(s) | [u(s) + wa(s)] 
= —— [u Wa(s)], 
s[(s/a) + 1] d 
or, with no disturbances, 
0(s) _ l 


x awan ee 


FIGURE 8.21 

Satellite tracking 
antenna. (Courtesy 
Ford Aerospace and 
Communications Corp.) 


FIGURE 8.22 
Schematic diagram of 
antenna. 
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8.16 


The discrete case, with u(n) applied through a zero-order hold, yields 


0(z) zb 
G2(z) = — = K ————————, 
7 Wa) ^ (- D - e) 

where 

T—14 e674 OME _ -aT 

K= a Tte re d aTe 
a GT = CF gmr 

a) Write the equations in state form with x; = y. Give the matrices F, G, and H. 


Let a = 0.1. 

b) Letting T = 1, design K for equivalent poles at s = —(1/2) + j (n). Plot 
the step response of the resulting design. 

c) Design an estimator with L selected so that a(z) = z?; that is, poles are at the 
origin. 

d) Use the estimated states for computing the control and introduce the reference 
input so as to leave the state estimate undisturbed. Plot the step response from 
this reference input and from a wind gust (step) disturbance. 

e) Plot the root locus of the closed-loop system with respect to the plant gain and 
mark the locations of the closed-loop poles. 


Tank fluid temperature control. The temperature of a tank of fluid with a constant 
flow rate in and out is to be controlled by adjusting the temperature of the incom- 
ing fluid. The temperature of the incoming fluid is controlled by a mixing valve 
that adjusts the relative amounts of hot and cold supplies of the fluid (see Fig. 8.23). 
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FIGURE 8.23 
Tank temperature control. 


Tec 


Negligible heat loss in walls 


Because of the distance between the valve and the point of discharge into the tank, 
there is a time delay between the application of a change in the mixing valve and the 
discharge of the flow with the changed temperature into the tank. The differential 
equation governing the tank temperature is 


. 1 
T, = om n — Gout): 


T, = tank temperature, 
c = specific heat of the fluid, 


M = fluid mass contained in the tank, 


Gin = CMinT ei, 
Jou = CMouTe, 
m = mass flow rate (Min = Mout), 
T,; = temperature of fluid entering tank. 


The temperature at the input to the tank at time ż, however, is the control temperature 
Tq seconds in the past, which may be expressed as 


T,i(t) = T(t "n Ta), 


where 
Ta = delay time, 
Tec = temperature of fluid immediately after the control valve and directly 


controllable by the valve. 
Combining constants, we obtain 
Telt) + aT,(t) = aTec(t — Ta), 


where 
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which, transformed, becomes 


Te(s) |^ e^" 
T.(s)  (s/a) 1 


= G3(s). 


To form the discrete transfer function of G3 preceded by a zero-order hold, we must 
compute 


] - e e 745 
G M M, d rr F 
xz) | S (s/a) + i} 


We assume that 7; = IT — mT, 0 < m < 1. Then 


|= e^ efsT e™sT 
G) = 2] Bá 
a(z) | $ (s/a) + i} 
msT 
=(1-— =j “Eg Pe Gu 
U- M | s(s/a) + 1 
msT msT 
= {i =s eiz e _ £ 
U= "yz | " ere 
z—1 1 —a(t+mT) 
" azil +mT)-e I(t + mT)} 
z- 1 T = E e T 
z zfí\z-1 z-—e-'T 
B 1 (1 _ gent), db eg ?nT = e ?T 
a. 7. CEN" 


l-e™ gta . 
zt z—e-' 


e ?"T aT 


— e 
1 — eamT 


It is easy to see that the zero location, —a@, varies from a = © atm = 0toa =0 
as m — 1 and that G3(1) = 1.0 for all a, m, and l. For the specific values of 
7; = 1.5, T = 1, and a = 1, the transfer function, with / = 2 and m = 1/2, 
reduces to 


z + 0.6065 


G3(2) = 7377 — 0.3679) 


a) Write the equations in state-space form. 

b) Design a feedback gain such that a.(z) = z?. 

c) Design an estimator such that a,(z) = z?. 

d) Plot the root locus of the system with respect to the plant gain. 
e) Determine the step response of the system. 


Appendix A: Laplace Transforms 


Laplace transforms can be used to study the complete response characteristics of 
feedback systems, including the transient response. This is in contrast to the use 
of Fourier transforms in which the steady-state response is the main concern. The 
Laplace transform of f (t) denoted by L{f (t)} = F(s) is a function of the complex 
variable s = c + jw, where 


oc 


F(s) ê | f(t)e ^ dt (A.1) 


and is referred to as the unilateral (or one-sided) Laplace transform.* A function 
f(t) will have a Laplace transform if it is of exponential order, which means if 
there exists a real number ø such that 


lim |f (t)e^7'| = 0. (A.2) 


For example, ae"' is of exponential order, whereas e" is not. If F(s) exists for 


some So = Oo + j@o, then it exists for all s such that 
Re(s) = do. (A.3) 


The smallest value of a for which F(s) exists is called the abscissa of conver- 
gence, and the region to the right of Re(s) = o» is called the region of convergence. 


* Bilateral (or two-sided) Laplace transforms and the so-called £ + transforms, in which the lower value 
of integral is 0+, also arise elsewhere. 
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TABLE A.1 
Properties of Laplace 
Transforms 


Typically, two-sided Laplace transforms exist for a specified range, 


a € Re(s) « B, 


which defines the strip of convergence. Some properties of Laplace transforms are 
listed in Table A.1 and some Laplace transform pairs are listed in Table A.2. For a 
thorough study of Laplace transforms and extensive tables, the reader is referred to 
Churchill (1972), Campbell and Foster (1948), and, for the two-sided transform, 


Van der Pol and Bremmer (1955). 


Number 


11 


Laplace transform 


F(s) 
aF\(s) + BF2(s) 
F(s)e ^^ 


sr 


F(s +a) 


s" F(s) — s"^!f(Q0) 
—s"-? f (0) cd ER ES f YQ) 
[f (t)dt|0 
S 


lp(s) + 
S 


F\(s)F2(s) 


lim sF(s) 


lim sF(s) 


1 cT jo 
= | X F(QFxG - dé 


c- jo 


d 
~ af ts) 


Time function 


f(t) 
a filt) + B fxt) 
f(t — A) 


f(at) 
e *' f(t) 


rr" 


| rox 


filt) * fat) 
fO+) 


in fo 
Ai) fof) 


t f (t) 


Comment 


Transform pair 
Superposition 
Time delay 
(A= 0) 


Time scaling 


Shift in 
frequency 


Differentiation 


Integration 


Convolution 


Initial-value 
theorem 


Final-value 
theorem 


Time product 


Multiplication 
by time 


TABLE A.2 
Table of Laplace 
Transforms 


Number 


oN QN tA A U N 


20 


21 


1/s* 

2Us? 
31/54 
mi/s™*! 
l/(s + a) 
Is + ay 


Is + ay 


l/s + a)” 


a ON 

s(s + a) 

=. 

s?(s + a) 
bB-—4 

(s + a)(s + b) 
S 

(s + a)? 


gt 
s(s + ay 
(b — a)s 
(s + a)(s + b) 
a/(s? + a?) 
s/(s? + a?) 
yc 
starr 
MA Ase 
Etar 4b 
a? + b? 


s [(s + a)? + b?] 
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-ape ^ 


1-—e "(1 + at) 
—at 


be" — ae 


sin at 


cos at 


e *' cos bt 
e ^ sin bt 


1-e"* (cos bt + z sin bt | 
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B.1 


Appendix B: A Review of 


Complex Variables 


This appendix is a brief summary of some results on complex variable theory 
with emphasis on the facts needed in control theory. For a comprehensive study of 
basic complex variable theory the reader is referred to standard textbooks such as 
Churchill et al.(1976). 


The Definition of a Complex Number 


The complex numbers are distinguished from purely real numbers in that they also 
contain the imaginary operator, which we shall denote by j. By definition 


p--1 o f= VH1 (B.1) 
A complex number may be defined as 
A=o+ jw (B.2) 
where c is the real part and w is the imaginary part: 
c = Re{A} w = Im{A}. (B.3) 


Note that the imaginary part of A is itself a real number. We may represent the 
complex number A in the cartesian coordinate system as shown in Fig. B.1(a). 
The complex plane is shown and A is represented by a single point. An alternative 
representation is in the polar form. The complex number is represented by a vec- 
tor with length r and an angle 0 where the angle is in radians and is measured from 


FIGURE B.1 
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(a) Cartesian representation of a complex number; (b) polar representation of a complex number. 


Im(s) 


Im(s) 


(a) 


(b) 


the positive real axis in the counter-clockwise direction as shown in Fig. B.1(b). 
The complex number, A, in polar form is denoted by 


A = Alzaga) = rZ0 = re" 050<22 (B.4) 
r —-|A| = Jo? +o?) (B.5) 


where the number r is the length of the vector representing A and is called the 
magnitude or modulus or absolute value of A and 


tan(@) = — (B.6) 
c 
The conjugate of A is defined as 
A'-3- jo (B.7) 
therefore, 
(A) =A (B.8) 
(A; + A! = A + A?! (B.9) 
Fal = = (B. 10) 
Re(A) = E Im(A) — a (B.11) 
and 
AA" = (A: (B.12) 
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B.2 Algebraic Manipulations 


FIGURE B.2 

(a) Addition of complex 
numbers; (b) multiplica- 
tion of complex numbers; 
(c) division of complex 
numbers. 


The rules for addition, multiplication, and division are as expected. Let 
A; = gi + ja A2 = 02 + jo» (B.13) 
then 
A; + A» = (dj + jwi) + (02 + jwz) = (0; + 95) + j(@, + w2). (B.14) 


Complex numbers may be added or subtracted graphically. Each complex number is 
represented by a vector extended from the origin. The sum is obtained by adding the 
two vectors by constructing a parallelogram as shown in Fig. B.2(a). Alternatively, 
starting at the tail of one vector one may draw a parallel vector to the other. 


AjA2 = (d + jwi) + jw2) 
= (70102 — 09402) + j(W102 + 9102). (B.15) 


The product of two complex numbers may be done graphically using polar repre- 
sentations as shown in Fig. B.2(b). The division of two complex numbers is carried 


B.3 
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out by rationalization. This means that both the numerator and denominator in the 
ratio are multiplied by the conjugate of the denominator: 


A A\A2" 
A2 A2A?2 
70,0» + wiw) + jwi — 
_ (0192 l 2) s 2 — 810) (B.17) 
(05 + w5) 
From Eq. (B.4) it follows that 
zii l o 
A“ = P J r #0. (B.18) 
Also if Ay = r,e/® and A; = rze/® then 
A1A2 = r,r2e/€1*92 (B.19) 
and 
A 
Al 10:9) r> Æ 0. (B.20) 


A» r2 


The division of complex numbers may be carried out graphically in polar coordi- 
nates as shown in Fig. B.2(c). 


Graphical Evaluation of Magnitude and Phase 


Consider the transfer function 


gar, + zi) 


puisse (B.21) 
Lais t pi) 


G(s) — 


The value of the transfer function for sinusoidal inputs is found by replacing s by 
jw. The gain and phase are given by G(j«) and may be determined analytically 
or by a graphical procedure. Consider the pole-zero configuration for such a G(s) 
and a point so = j@o on the imaginary axis as shown in Fig. B.3. Also consider 
the vectors drawn from the poles and the zero to so. The magnitude of the transfer 
function evaluated at sọ = jwo is simply the ratio of the distance from the zero 
to the product of all the distances from the poles: 


IG(joo)| = ——. (B.22) 
raffa 
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FIGURE B.3 
Graphical determination 
of magnitude and phase. 


FIGURE B.4 
Illustration of graphical 
computation of (s + z1). 


The phase is given by the sum of the angles from the zero minus the sum of the 
angles from the poles: 


arg{G(jwo)} = LG(jwo) = 0; — (02 + 03 + 04). (B.23) 


This may be explained as follows. The term s + zı is a vector addition of its two 
components. We may determine this equivalently as s — (—z,), which amounts to 
translation of the vector s + z, starting at —z, as shown in Fig. B.4. This means 
that a vector drawn from the zero location to so is equivalent to s + zı. The same 
reasoning applies to the poles. We reflect pı, p», and p3 about the origin to obtain 
the pole locations. Then the vectors drawn from — p;,— p», and — ps to So are 
the same as the vectors in the denominator represented in polar coordinates. Note 
that this method is not limited to the evaluation on the imaginary axis. The same 
method may be used for so at other places in the complex plane. 
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B.4 Differentiation and Integration 


B.5 


The usual rules apply to complex differentiation. Let G(s) be differentiable with 
respect to s then 

dG(s) | dRe(G(s)) A , dIm(G(s)) 

ds ds Ids 


(B.24) 


The standard rules also apply in the integration except that the constant of integra- 
tion is a complex constant: 


| G(s)ds = | Recas + j | ImG(s)pas +c (B.25) 


where c is a complex constant. 


Euler’s Relations 


Let us now derive an important relationship involving the complex exponential. 
Define 
A = cos(0) + j sin(@) (B.26) 


where @ is in radians. Then 


ci = —Ssin(0) + jcos(0) = j^ sin(@) + j cos(@) 
= j(cos(0) + j(sin(0)) = jA. (B.27) 
Collecting the terms involving A we obtain 
— j d. (B.28) 
Integrating both sides of (B.28) yields 
In(A) = jO0 +c (B.29) 
where c is a constant of integration. If we let 0. = O in (B.29) we find that 
c = 00r 
A = e}? = cos(0) + j sin(0). (B.30) 
Similarly, 


A* = eJ? = cos(0) — j sin(0). (B.31) 
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B.6 


B.7 


B.8 


From (B.30) and (B.31) it follows that 


i8 — j0 
cos(0) = ee (B.32) 


and 


ang) = ——————., (B.33) 


Analytic Functions 


Assume that G is a complex valued function defined in the complex plane. Let 
$9 be in the domain of G, which is assumed to be finite in some disk centered at 
so. Thus G(s) is defined not only at so but also at all points in the disk centered at 
so. The function G is said to be analytic if its derivative exists at so and at each 
point in the neighborhood of so. 


Cauchy's Theorem 


A contour is a piecewise smooth arc that consists of a number of smooth arcs 
joined together. A simple closed contour is a contour that does not intersect itself 
and ends on itself. Let C be a closed contour and let G be analytic inside and on 
C as shown in Fig. B.5(a). Cauchy's theorem states that 


p G(s)ds = 0. (B.34) 
C 


A corollary to this theorem is the following. Let C; and C2 be two paths connecting 
the points A; and A» as in Fig. B.5(b), then 


| G(s)ds — =| G(s)ds. (B.35) 
C; C2 


Singularities and Residues 


If a function G(s) is not analytic at so but is analytic at some point in every neigh- 
borhood of so, so is said to be a singularity of G. A singular point is said to be 


FIGURE B.5 
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(a) A closed contour. (b) Two different paths between A, and A>. 


Im(s) 


(a) 


Im(s) 


Ag 


Re(s) 


(b) 


an isolated singularity if G(s) is analytic everywhere else in the neighborhood of 
So except at so. Let G(s) be a rational function (i.e., ratio of polynomials). Then 
G(s) is analytic except at the location of the poles (i.e., roots of the denominator). 
All singularities of rational algebraic functions are the pole locations. Let a ratio- 
nal G(s) be analytic except at so. Then we may write G(s) in its Laurent-series 
expansion 


A-n “ee A-| 


Cis} aa. 
(s) (S — So)" (s — So) 


+ Bo + Bi(s — So) + ***. (B.36) 


The coefficient A-, is called the residue of G(s) at so and may be evaluated by 
Cauchy’s integral formula as 


A-, = zi G(s)ds (B.37) 
2Tilc 


where C denotes a closed arc within an analytic region centered at so and contains 
no other singularity as shown in Fig. B.6. so is not repeated with n — 1 and in 
this case, 


A-, = Res(G(s); so) = (s — so)G(s)| = so (B.38) 


which is the familiar “cover up" method of computing residues. 
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FIGURE B.6 
Contour around an 
isolated singularity. 


B.9 


B.10 


Residue Theorem 


If the contour C contains / singularities, then (B.38) may be generalized to yield 
Cauchy’s residue theorem: 


1 i=l 
sap G(s)ds = > Res(G(s); s;). (B.39) 


i=l 


The Argument Principle 


Before stating the argument principle, we need a preliminary result from which the 
principle follows readily. Let G(s) be an analytic function on and inside a closed 
contour C except for a finite number of poles inside C. Then for C described in a 
positive sense (clockwise direction), 


1 G(s), _ H 
x] que o Nc? (B.40) 
or 
ae p d{inG] = N - P (B.41) 
27 j 


where N and P are the total number of zeros and poles of G inside C, respectively. 
A pole or zero of multiplicity k is counted k times. 
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Proof: Let sọ be a zero of G with multiplicity k. Then in some neighborhood 
of that point we may write G(s) as, 


G(s) = (s — so) f (s) (B.42) 
where f(s) is analytic and f(so) ~ 0. If we differentiate (B.41) we obtain 
G'(s) = k(s — so)" ! f(s) + (s — so f (s). (B.43) 
Now (B.40) may be rewritten as 
Gi. X y fw (B.44) 


G(s)  (s—so f(s)’ 


Therefore, G'(s)/G(s) has a pole at s — so with residue K. This analysis may be 
repeated for every zero. Hence, the sum of all the residues of G'(s)/G(s) is the 
number of zeros of G(s) inside C. If so is a pole with multiplicity / we may write 


h(s) = (s — so)! G(s) (B.45) 


where A(s) is analytic and A(s9) # 0. Then (B.42) may be rewritten as 


G(s) — E N (B.46) 
(s — So)! 
Differentiating (B.43) we obtain, 
(9) = BO _ _ Ants) 
G0 = G-s) G3) diu 
so that 
chr P ee (B.48) 


G(s)  (s—so h(s)’ 


This analysis may be repeated for every pole. The result is that the sum of the 
residues of G'(s)/G(s) at all the poles of G(s) is —P. We now state the argument 
principle. 

Using (B.38): 


zi d[InG(s)] = (N — P) (B.49) 
2mj jc 


where d/ds ln G(s) was substituted for G'(s)/G(s). If we write G(s) in polar form 
then, 


$ d [InG(s)] = $ d | [In|G(s)| + jarg(InG(s)]} 
r r 


= In|GG)| Z5? + j arg[GG][z 2. (B.50) 


S= S] 
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Since I is a closed contour, the first term is zero but the second term is 277 times 
the net encirclements of the origin: 


= d [InG(s)] = N — P. (B.51) 
2mj jr 

Intuitively, the argument principle may be stated as follows. Let G(s) be 
a rational function that is analytic except possibly at a finite number of points. 
Select an arbitrary contour in the s-plane so that G(s) is analytic at every point 
on the contour (the contour does not pass through any of the singularities). The 
corresponding mapping into the G(s) plane will encircle the origin a number of 
times, in the same sense as the s-plane contour, equal to the difference between the 
zeros and poles of G(s) encircled by the s-plane contour. For example, if the contour 
encircles a single zero, the mapping will encircle the origin once in the clockwise 
direction. Similarly, if the contour only encloses a single pole, the mapping will 
encircle the origin in the counter-clockwise direction. If the contour encircles no 
singularities, or if the contour encloses an equal number of poles and zeros, there 
will be no encirclement of the map of the origin. A contour evaluation of G(s) 
will encircle the origin if there is a nonzero net difference between the encircled 
singularities. The mapping is conformal as well, which means that the magnitude 
and sense of the angles between smooth arcs is preserved. Chapter 5 provides a 
more detailed intuitive treatment of the argument principle and its application to 
feedback control in the form of the Nyquist stability theorem. 


C.1 


C.2 


Appendix C: Summary of Matrix Theory 


We assume that the reader is already somewhat familiar with matrix theory and with 
the solution of linear systems of equations. However, a brief summary of matrix 
theory is presented here, with emphasis on the results needed in control theory. 
The reader is referred to Strang (1988) and Gantmacher (1959) for further study. 


Matrix 


An array of numbers arranged in rows and columns is referred to as a matrix. If 
A is a matrix with m rows and n columns, an m X n (read m by n) matrix, it is 
denoted by 


aj Gio "'' Ain 
a2) AR "'' Ann 

A=| . NET i. 
Ami Am "'' Amn 


where the entries a;; are its elements. If m = n, then the matrix is square; other- 
wise it is rectangular. Sometimes a matrix is simply denoted by A = [a;;]. If m = 
lorn = 1, then the matrix reduces to a row vector or a column vector, respectively. 


Elementary Operations on Matrices 


If A and B are matrices of the same dimension, then their sum is defined by 
C = A +B, (C.2) 
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C3 


C.4 


where 
cij = aij + bij; (C.3) 
that is, the addition is done element by element. It is easy to verify that 
ATB-B-A, (C.4) 
(A-B)-C-A-(B-«C). (C.S) 


Two matrices can be multiplied if they are compatible. Let A = m X n and 
B = n X p, then the m X p matrix, 


C = AB, (C.6) 


is the product of the two matrices, where 
n 
Cij = 2 aub. (C.7) 
k=l 


Matrix multiplication satisfies the associative law 
A(BC) = (AB)C (C.8) 
but not the commutative law; that is, in general, 


AB = BA. (C.9) 


Trace 


The trace of a square matrix is the sum of its diagonal elements; 


trace A = 2 aii. (C.10) 


i=] 


Transpose 


The n X m matrix obtained by interchanging the rows and columns of A is called 
the transpose of matrix A 


aj A21 `°’ dml 
A=]. 4. ME (C.11) 


Ain  O2n ``? Amn 
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A matrix is said to be symmetric if 


A = A; (C.12) 
It is easy to show that 
(AB)! = B'AT (C.13) 
(ABC)! = C'pBlAT (C.14) 
(A +B)’ = AT + Bf. (C.15) 


Matrix Inverse and Determinant 


The determinant of a square matrix, denoted by "det," is defined by Laplace's 
expansion 


n 
det A = > di j'yij for any 1 = 1,2, ..., f, (C.16) 
j=l 


where yj; is called the cofactor and 
yij = -1*! det Mij, (C.17) 


where det M; is called a minor. The term M;; is the same as the matrix A except 
that its ith row and jth column have been removed. Note that M;; is always an 
(n — 1) X (n — 1) matrix, and the minors and cofactors are identical except possibly 
for a sign. 

The adjugate of a matrix is the transpose of the matrix of its cofactors 


adj A = [yi]. (C.18) 


It can be shown that (A)(adjA) = (det A)I. If det A # 0, then the inverse of a 
matrix A is defined by 


- adj A 
A = C.19 
det A ) 
and has the property that 

AA™! = A'A =I, (C.20) 

where I is called the identity matrix: 

0 I Wama 

I=]: TEES 5, M (C. 2l) 


650 Appendix C / Summary of Matrix Theory 


C.6 


that is, with 1s along the diagonal and Os elsewhere. Note that a matrix has an 
inverse —that is, it is nonsingular if its determinant is nonzero. The inverse of the 
product of two matrices is the product of the inverse of the matrices in reverse 
order: 


(AB)! -B'!A'! (C. 22) 
and 


(ABC)! = C^!p^!A^!. (C.23) 


Properties of the Determinant 
When dealing with determinants of matrices, the following elementary (row or 
column) operations are useful. 


1. If any row (or column) of A is multiplied by a scalar a, the resulting matrix A 
has the determinant 


detA = a det A. (C.24) 
Hence 
det[qA] = a” det A. (C.25) 
2. If any two rows (or columns) of A are interchanged to obtain A, then 
detA = — det A. (C.26) 
3. If a multiple of a row (or column) of A is added to another to obtain A, then 
detA = det A. (C27 
It is also easy to show that 
det A = det A’ (C.28) 
and 
det[AB] = det A det B. (C.29) 


Using the latter relation on Eq. (C.20) we have that 
detAdetA ! = 1. (C.30) 
If A and B are square matrices, then the determinant of the block triangular 


matrix 


det} o B 


ja 4 = det A det B (C31) 


is the product of the determinants of the diagonal blocks. 
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If A is nonsingular, then 


A 3 = det Adet[D — CA^!B]. (C.32) 


det} c, D 


Using this identity, the transfer function of a scalar system can be written in a 
compact form: 


sI-F 4 
det -H J 
G(s) = H(sI-F) 'G +J = —————. 
(s) (s ) det [sI — F] oop) 
C.7 Inverse of Block Triangular Matrices 
If A and B are square invertible matrices, then 

—] 2» 

A C A! -A'ICB' 
E J -| 0 p^! fo 


C.8 Special Matrices 


Some matrices have a special structure and are given a name. We have already 
defined the identity matrix, which,has a special form. A diagonal matrix is one 
with nonzero elements along the main diagonal and zeroes elsewhere: 


11 0 
A = 433 ; (a) 


0 Bax 


A matrix is said to be (upper) triangular, if all the elements below the main diagonal 


are zero: 
ay amp UU Ain 
0 an ! 
Az|: 0 coms (C.36) 
0 i 


0 0 0 Thin 
The determinant of a diagonal or triangular matrix is simply the product of its 
diagonal elements. 
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A matrix is said to be in the (upper) companion form if it has the structure 


"Hi 7» — Gn 
l 0 es 
AÁ,-| 0 l Hor B (C.37) 


Note that all the information is contained in the first row. Other variants of this 
form are the lower left or right companion matrices. A Vandermonde matrix has 
the following structure 


2 wee =] 
ln gai. øi aj 
l az uj 55 gl 
Ker. ‘car (C.38) 
2 n] 
|l an a; ü, 


C.9 Rank 


The rank of a matrix is the number of its linearly dependent rows or columns. If 
the rank of A is r, then all (r + 1) X (r + 1) submatrices of A are singular, and 
there is at least one r X r submatrix that is nonsingular. It is also true that 


Row rank of A — Column rank of A. (C.39) 


C.10 Characteristic Polynomial 


The characteristic polynomial of a matrix A is defined by 
a(s) = det[sI — A] 
= s" + ays") +++ + asas + An, (C.40) 


where the roots of the polynomial are referred to as eigenvalues of A. We can 
write 


a(s) = (s — As — A2): (s — An), (C.41) 


where {A;} are the eigenvalues of A. The characteristic polynomial of a companion 
matrix is 


a(s) = det[sI — A,] = s" + ais" ! + +++ + a, 45 + An. (C.42) 


C.11 


C.12 


C.13 
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The Cayley-Hamilton Theorem 


The Cayley-Hamilton theorem states that every square matrix A satisfies its char- 
acteristic equation. This means that if A is an n X n matrix with characteristic 
equation a(s), then 


a(A) $ A" c aA" Fa, A t auI = 0. (C.43) 


Eigenvalues and Eigenvectors 


If A 1s a scalar and V is a nonzero vector, then 
AV = AV (C.44) 


defines A as the eigenvalue of the square matrix A and V is the associated (right) 
eigenvector. If we collect both terms on the right, 


(AI — A)V = 0. (C.45) 
Since V is nonzero, then 
det [AI — A] = 0 (C.46) 


so that A is an eigenvalue of the matrix A as defined earlier. The normalization 

of the eigenvectors is arbitrary; that is, if V is an eigenvector so is o V. The 

eigenvectors are usually normalized to have unit length; that is |V|? = VTV = 1. 
If WT is a nonzere row vector such that 


W'A = AW’, (C.47) 
then W is called a left eigenvector of A. Note that we can write 
ATW = AW (C.48) 


so that W is simply a right eigenvector of AT. 


Similarity Transformations 


Consider the arbitrary nonsingular matrix T such that 
A = TAT, (C.49) 


This kind of matrix operation is referred to as a similarity transformation. If A has 
a full set of eigenvectors, then T can be chosen to be the set of eigenvectors and 
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A will be diagonal. Consider the set of equations in state-variable form: 


x = Fx + Gu. (C.50) 
If we make a change of variables 
Té = x, (C.5I) 
then 
Té = FTé + Gu, 
é = T FTE +T'Gu 
= Fé + Gu, (C.52) 
where 
F = T FT 
G = 7G. (C.53) 


The characteristic polynomial of F is 
det[sI — F] = det[sI — T 'FT] 
dei[sT 'T - T 'FT] 
det[T '(sI — F)T] 
det T! det[sI — F] det T. (C.54) 


Using Eq. (C.30) then, 
det[sI — F] = det[sI — F]. (C.55) 


From Eq. (C.55) one can see that F and F both have the same characteristic 
polynomial, and we have the important result that a similarity transformation does 
not change the eigenvalues of a matrix. From Eq. (C.51) a new state made up of 
a linear combination of the old state has the same eigenvalues as the old set. 


Matrix Exponential 


Let A be a square matrix. The matrix exponential of A is defined as the series 
e^ = Lt At t AU! + A OBI +. (C.56) 


It can be shown that the series converges. If A is an n X n matrix, then e^' is also 
an n X n matrix and can be differentiated: 


La 


= e" = Ae, (C.57) 


C.15 


C.16 
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Other properties of matrix exponential are 
giu =m garta) (C.58) 
and 
e^eP + eB eA (C.59) 


unless A and B commute, that is, AB = BA. 


Fundamental Subspaces 


The range space of A (or the column space of A) is defined by the set of 
vectors X; 


x = Ay (C.60) 


for some vector y. The range space of A is denoted by 9t(A). 
The null space of A is defined by the set of vectors x such that 


Ax = 0 (C.61) 


and is denoted by N(A). If xeN(A) and ye9t(A?), then y'x = 0; that is, every 
vector in the null space of A is orthogonal to every vector in the range space 
of AT. 


Singular Value Decomposition 


The singular value decomposition (SVD) is one of the most useful tools in linear 
algebra. It has been widely used in control theory during the last decade. Let A be 
an m X n matrix. Then there always exist matrices U, S, V such that 


A = USV" 
where U and V are orthogonal matrices, 
UU'-IL VV'-I 


and S is a quasi-diagonal matrix with the singular values as its diagonals 


$-h 0 


0 0 
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where È is a diagonal matrix of nonzero singular values in descending order 
gu cm mm oum o, D 


The unique diagonals of S are called the singular values. The maximum singular 
value is denoted by F(A) and the minimum singular value is denoted by a(A). 
The rank of the matrix is the same as the number of nonzero singular values. The 
columns of U and V, 


U = [uiu2 um] 
V = [viva v4] 


are called the left and right singular vectors, respectively. Using SVD provides 
complete information about the fundamental subspaces associated with a matrix: 


N(A) = spaniv,.si Vr+2 de Vn] 
9A) = span{u,; u2 - uj 
R(A') = span{y, v © vj) 
N(A') = span{uys, Ura2 c Um} 


The norm |[Al|; of the matrix is given by 
|All, = F(A) 
If A is a function of w then the |A||. is given by 
[Ale = max (a) 


Positive Definite Matrices 


A matrix A is said to be positive semidefinite if, 
x'Ax = 0, all x. 


The matrix is said to be positive definite if, in the above, equality holds only for 
x = 0. A symmetric matrix is positive definite if and only if all of its eigenvalues 
are positive. It is positive semidefinite if and only if all of its eigenvalues are 
nonnegative. An alternative method for determination of positive definiteness is 
by a test of minors of the matrix. A matrix is positive definite if all the leading 
principal minors are positive. It is positive semidefinite if they are all nonnegative. 
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